INTRINSIC NOTION OF PRINCIPAL SYMBOL 
FOR THE HEISENBERG CALCULUS 



RAPHAEL PONGE 

Abstract. In this paper we define an intrinsic notion of principal for the Hypoelliptic calculus on 
Heisenberg manifolds. More precisely, the principal symbol of a $jjDO appears as a homogeneous 
section over the linear dual of the tangent Lie algebra bundle of the manifold. This definition is 
an important step towards using global if -theoretic tools in the Heisenberg setting, such as those 
involved in the elliptic setting for proving the Atiyah-Singer index theorem or the regularity of the 
eta invariant. On the other hand, the intrinsic definition of the principal symbol enables us to give 
an intrinsic sense to the model operator of ^//DO at point and to give a definitive proof that the 
Heisenberg calculus is modelled at each point by the calculus of left-invariant ^DO's on the tangent 
group at the point. This also allows us to define an intrinsic Rockland condition for $jjDO's which 
is shown to be equivalent to the invertibility of the principal symbol, provided that the Levi form 
has constant rank. Furthermore, we review the main hypoellipticity results on Heisenberg manifolds 
in terms of the results of the paper. In particular, we complete the treatment of the Kohn Laplacian 
of |BG| and establish that for the horizontal sublaplacian the invertibility of the principal symbol 
is equivalent to some condition on the Levi form, called condition X(k). Incidentally, this paper 
provides us with a relatively up-to-date overview of the main facts about the Heisenberg calculus. 



1. Introduction 

The aim of this paper is to define a global and intrinsic notion of the principal symbol for 
the hypoelliptic calculus on Heisenberg manifolds, along with some applications. On the way, we 
complete the treatment of the Kohn Laplacian of [BG and gives a complete treatment for the 
horizontal sublaplacian on a Heisenberg manifold acting on forms. 

Recall that a Heisenberg manifold (M, H) consists of a manifold M together with a distinguished 
hyperplane bundle H C TM. This definition includes as main examples the Heisenberg group and 
its quotients by cocompact lattices, (codimension 1) foliations, CR and contact manifolds, as well as 
the confolations of |ET| . Moreover, in this context the natural operators such as Hormander's sum 
of squares, the Kohn Laplacian, the horizontal sublaplacian or the contact Laplacian of |Ruj . while 
they may be hypoelliptic, are definitely not elliptic. Thus, the standard elliptic calculus cannot be 
used efficiently to study these operators. 

The relevant substitute to the elliptic calculus is the Heisenberg calculus of Beals-Greiner jBGj 
and Taylor Tay , which extends seminal works of Boutet de Monvel |Bolj . Dynin ( |Dyl , Dy2| ) 



and Folland-Stein [EH] (see also [BHHj . jCUGPj . jKMMj . |GrTj . |H63 ). The idea in the Heisenberg 
calculus, which goes back to Elias Stein, is to build a pseudodifferential calculus on Heisenberg 
manifolds modelled on that of left-invariant pseudodifferential operators on nilpotent groups. This 
stems from the fact that the relevant tangent structure for a Heisenberg manifold (M, H) is that of 
a bundle GM of two-step nilpotent Lie groups (see jHH], jEij, jKMMj . jFS] . jHroj . jPo2j . |TToS| ). 

In the original monographs jBGj and jlayj the principal symbol is only defined in local coordi- 
nates, so the definition a priori depends on the choice of these coordinates. In the special case of 
a contact manifold, an intrinsic definition have been given in the unpublished book (EMM], as a 
section over a bundle of jets of vector fields representing the tangent group bundle of the contact 
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manifold. This approach is similar to that of Melrose |Me2j in the setting of the 6-calculus for 
manifolds with boundary. 

In this paper we give an intrinsic definition of the principal symbol, valid for an arbitrary 
Heisenberg manifold, in terms of the description of the tangent Lie group bundle in |Po2j . As 
a consequence, we can reformulate in a global fashion previously known criterions for existence 
of parametrices in the Heisenberg calculus. In particular, we can define a Rockland condition for 
operators in the Heisenberg calculus in a fully intrinsic way and show that this condition allows 
to determine the existence of a parametrix when the Levi form of the Heisenberg manifold has 
constant rank. 

More importantly, since our approach of the principal symbol connects nicely with the construc- 
tion of the tangent groupoid of a Heisenberg manifold in |Po2j . this presumably allows us to make 
use of global .fT-theoretic arguments in the Heisenberg setting, as those involved in the proof of the 
(full) Atiyah-Singer index theorem ( AS1 , AS2 .) and the regularity of the eta invariant for gen- 
eral selfadjoint elliptic TOO's ( |AP8j . |Oi| ) or, equivalently, the vanishing of the noncommutative 
residue of a ^DO projection (see |Wolj . |BL| . |Polj ). More precisely, this paper can also be seen 
as a step towards extending the aforementioned results to the Heisenberg setting. 

On the other hand, for strictly pseudoconvex CR manifolds this should allows us to recover and 
to extend in a rather simple way a recent result of Hirachi |Hij on the invariance of the integral of 
the logarithmic singularity of the Szego kernel (see also [Bo2 ) , in connection with the program of 
Fefferman |Fe| for the Szego and the Bergman kernels on strictly pseudoconvex complex domains. 

1.1. Intrinsic notion of principal symbol for the Heisenberg calculus. Given a Heisenberg 
a manifold (M, H ) and a vector bundle £ we let q* M denote the linear dual of the Lie algebra 
bundle associated to the tangent Lie group bundle. For m G C we let ^^(M, £) denote the class of 
^DO's of order m acting on section of £ and, letting ir : Q*M — > M be the canonical projection, 
we define S m (M,£) as the space of sections p m G C°°(g*M \ 0, End^i?) such that for any A > 
we have 

(1-1) p m (A%,AO = A> m (£ ,O, to & (TM/H)*, i'^H*. 

The principal symbol of an operator P £ ^/^(M,£) is obtained as an element of S m (g*M, £) 
as follows. As shown in Po2 the tangent Lie group bundle GM of a Heisenberg manifold (M, H) 
can be described as the bundle (TM/H) © H endowed with a law group encoded by the Levi form 
C : H x H — > TM/H such that, for sections X and Y of H, we have 

(1.2) C(X, Y) = [X, Y) mod H. 

It is also shown in |Po2j that at a point x £ M this approach to GM is equivalent to the extrinsic 
one in |BG| in terms of the Lie group of a nilpotent Lie algebra of jets of vector fields at point 
of a local chart. This is made by means of a special kind of privileged coordinates at x, called 
Heisenberg coordinates. 

As a byproduct of the equivalence between the two approaches, we obtain that in Heisenberg 
coordinates a Heisenberg diffeomorphism <j) : (M,H) — > (M',H') is well approximated by the 
induced isomorphism <p' H : GM — > GM' between the tangent Lie group bundles (see |Po2j ). This 
allows us to carry out the proof of the invariance by Heisenberg diffeomorphisms of the Heisenberg 
calculus in Heisenberg coordinates, rather than in privileged coordinates as in |BG| (see Section |HJ). 
As a consequence we can prove: 

Theorem 1.1. Let P : C^°(M,£) — > C°°(M, £) be a^nDO of order m. Then there exists a unique 
symbol a unique symbol a m {P) € S m (Q* M,£) such that, for any a £ M, the symbol cr m (P)(a, .) 
agrees in trivializing Heisenberg coordinates centered at a with the principal symbol of P at x = 0. 
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We call the symbol a m (P)(x,£) the principal symbol of P. In order to distinguish it from the 
other definition of the principal symbol in local coordinates, we will sometimes refer to it as the 
global principal symbol, while the other principal symbol will be called the local principal symbol. 

Let us now describe the main properties of the global principal symbol. First, we have: 

Proposition 1.2. For every m G C the principal symbol map o~ m : ^^(M, £) — > S m (Q*M, £) gives 
rise to a linear isomorphism ^(M,£)/^f r ^ 1 (M,£) -^-> S m (Q*M,£). 

If P G ^^(M, £) has principal symbol a m (P) then for any a G M we define the model operator 
P a of P at a as the operator as the left-invariant ^//DO Q n G a M with symbol o~ m (a, .), that is, 
the left-convolution operator with the inverse Fourier transform of a m (a, .) (see Definition I4.7|) . 

On the other hand, for any a G M the product law on G a M defines a product for symbols, 

(1-3) * a : S m MM) x S m2 (g*M) — > 5 mi+m2 ( :M). 

This product depends smoothly enough on a to give rise to a product 

(1.4) * : S mi ( Q *M,£) x S m2 ( *M,£) — ► S mi+ni2 (Q* M, £), 
such that for pj G (g*M, f ), j = 1, 2, we have 

(1.5) p mi *p m2 (a,0 = [p mi (a,.)* a p m2 (a,.)](0 V(a, £) G fl*M \ 0. 

This comes from the fact that in local coordinates the above product is nicely related to the product 
of local homogeneous symbols of |BG| . As a consequence we get: 

Proposition 1.3. For j = 1,2 let Pj G *^'(M,£) and suppose that P\ or P2 is properly supported. 

1) We have a mi+m2 (PiP 2 ) = 0" mi (P) * a m . 2 (P). 

2) At every point a G M the model operator of P1P2 is (PiP2) a = PfPjf. 

Next, it is shown in |BG| that the transpose of a ^//DO i s again a ^//DO. Thanks to the results 
of |Po2j . we can prove a version of this result in Heisenberg coordinates (see Sectional). As a 
consequence, we identify the principal symbol of transpose, for we get: 

Proposition 1.4. Let P G *^(M, £) have principal symbol a m (P). Then: 

1) The principal symbol of the transpose P l is a m (P t )(x,^) = cr m (x, — £)*; 

2) If P a is the model operator of P at a, then the model operator of P l at a is the transpose 
operator (P a )* : S (G X M, £*) S Q (G X M, £*). 

Assume now that M is endowed with a positive density and £ with a Hermitian metric, and let 
L 2 (M,£) be the associated L 2 -Hilbert space. Then we have: 

Proposition 1.5. Let P G ^f^(M,£) have principal symbol a m (P). Then: 

1) The principal symbol of the adjoint P* is am(P*)(%,Q = o~m{P)( x >Q* ■ 

2) If P a denotes the model operator of P at a G M then the model operator of P* at a is the 
adjoint (P a )* of P a . 

1.2. Rockland condition and hypoellipticity. It is shown in |BG| that, in local coordinates, 
the invertibility of the local principal symbol is equivalent to the existence of a ^ h DO parametrix. 
Thanks to Proposition 11.31 and the relationship in local coordinates between the local and global 
principal symbols, we can reformulate this result in a global fashion. More precisely, we have: 

Proposition 1.6. Let P : C c °°(M,f) -> C°°(M,£) be a ^ H DO of order m. Then the following 
are equivalent: 

1) The principal symbol o~ m (P) of P is invertible with respect to the convolution product for 
homogeneous symbols; 

2) The operator P admits a parametrix Q in *$>Jj m (M,£). 

Furthermore, if 1) and 2) hold then P is hypoelliptic with gain of ^-derivatives. 
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In fact, it may be difficult to determine whether the principal symbol of a ^^DO is invertible 
because in general the convolution product for symbols is not the pointwise product of symbols. In 
particular, in the Heisenberg setting, the product of principal symbols is neither commutative, nor 
microlocal. 

Nevertheless, to determine the invertibility of the principal symbol we can make use of a gen- 
eral representation theoretic criterion, the Rockland condition: a ^^DO-operator P satisfies the 
Rockland condition at a point a £ M when its model operator P a satisfies the Rockland condition 
on G a M, i.e., for every nontrivial irreducible unitary representation tt of G a M some (unbounded) 
operator irpa acting on the representation space of tt is injective on the space of smooth vectors of 

TT. 

It is well known that a left-invariant homogeneous ^DO on a nilpotent group is hypoelliptic if, 
and only if, it satisfies the Rockland condition, and it further admits an inverse if, and only if, 
together with its transpose it satisfies the Rockland condition (e.g. |HNlj . |HN2j . CGGP ). Thus 
if P is a ^//DO such that P and P t satisfies the Rockland condition at every point then, for 
any x E M, then the model operator of P x is invertible. However, whether this inverse depends 
smoothly enough with respect to x to yield an inverse for the principal symbol is a more delicate 
issue. 

We show here that this occurs when the Levi form (|1.2|) has constant rank, say 2n. In this case 
the tangent Lie group is a fiber bundle with typical fiber H 2n+1 x M. d ~ 2n . This allows us to make 
use of results of Christ et al. |C(tGP| about families of fDO's on a fixed nilpotent graded group 
to get: 

Proposition 1.7. Let P be a ^ hDO of order m, $tm > 0, and suppose that the Levi form hl.ty) 
has constant rank. Then the following are equivalent: 

(i) P and P* satisfy the Rockland condition at every point of M; 

(ii) P and P* satisfy the Rockland condition at every point of M; 

(Hi) The principal symbol of P is invertible. 

Ln particular, if (i) and (ii) holds then P admits a ^hDO parametrix and is hypoelliptic with loss 
of derivatives. 

In particular, when P is selfadfoint and the Levi form has constant rank the Rockland condition 
for P is equivalent to the invertibility of the principal symbol of P. 

Finally, if 2n denotes the rank of the Levi form at a then we have G a M ~ H 2n+1 x R d ~ 2n . 
Therefore, the irreducible unitary representations of G a M are two kinds, one dimensional represen- 
tations on C and infinite dimensional representations on L 2 (W n ). In the former case the Rockland 
condition corresponds to the invertibility of the principal symbol along H*, while in the latter case 
it is enough to look at the representations coming from that of H 2n+1 with Planck constants ±1 
(see Section [SJ). 

1.3. Hypoellipticity criterions for sublaplacians. It is interesting to look at the previous 
results in the case of sublaplacians, as this covers several important examples such as Hormander's 
sum of squares, the Kohn Laplacian or the horizontal sublaplacian. 

Here by sublaplacian we mean a differential operator A : C°°(M, £) — > C°°(M, £) such that near 
every point a G M we can write A in the form, 

(1.6) A = -(Xf + ...+X 2 )- in(x)X Q + 0^(1), 

where Xq, X%, . . . , Xj is a //-frame of TM, so that X\, . . . , Xj span H, the term fJ,(x) is a smooth 
section of End£ and the notation 0#(1) stands for a differential operator of Heisenberg order < 1. 

In this case the Rockland condition and the invertibility of the reduces to the following. Let 
L(x) = (Ljk(x)) be the matrix of C with respect to the //-frame Xq, X\, . . . , X^, so that for 



A 



j, k = 1, . . . , d we have 

(1.7) X fe ) = [Xj, X fe ] = L ifc (x)X mod H. 

Let 2n be the rank of C a and L(a), let Ai, . . . , denoting the eigenvalues of L(a) and consider the 
condition, 

(1.8) S P/ u(a)nA a = 0, 
where the singular set A a is defined as follows, 

(1.9) A a = (-oo,-- Trace \L(a)\] U [-Trace \L(a) \, oo) if 2ra < d, 

(1.10) A a = {±(2 Trace |L(a)| + 2a>j\\j\);aj <E N d } if 2n = d. 

As is turns out this condition makes sense independently of the choice of the i/-frame and is the 
relevant condition to look at in the case of a sublaplacian. More precisely, we have: 

Proposition 1.8. 1) The condition h6. 2°J\) makes sense intrinsically for any a S M. 

2) At every point a € M the Rockland conditions for A and A* are equivalent to 11. 

3) The principal symbol of A is invertible if and only if, the condition U.8\) holds at every point 
of M. Moreover, when the latter occurs A admits a parametrix in \I/^ 2 (M, £) and is hypoelliptic 
with loss of one derivative. 

The above result is proved in |BG| in the case of scalar sublaplacians, for which the coefficient 
n(x) in (|1.6|) is a complex- valued function, but the general case is not dealt with in |BG| . However, 
it is necessary to extend the result to sublaplacians acting on sections of vector bundles in order 
to deal with the Kohn Laplacian and the horizontal sublaplacian acting on forms. In particular, 
Proposition 11.81 allows us to complete the treatment of the Kohn Laplacian in |BG| (see below). 

1.4. Main examples of hypoelliptic operators on Heisenberg manifolds. We devote a 
section where we explain how the Heisenberg calculus, including the results of this paper, provides 
us with a unified framework to deal with the hypoellipticity of the main geometric operators on a 
Heisenberg manifold and to recover well-known results proved using various different approaches. 

(a) Hormander's sum of squares. A Hormander's sum of squares is an operator of the form A = 
— (Xf + . . . + X^) where X\,..., X m are vector fields on M. When X\, . . . , X m span H we get a 
sublaplacian and Proposition 11.81 allows us to recover, in this special case, the celebrated result of 
Hormander H62 about the hypoellipticity of sum of squares under the bracket condition. 

(b) Kohn Laplacian. The Kohn Laplacian is the Laplacian associated to the tangential Cauchy- 
Riemann complex, or ^-complex, on a CR manifold ([KB], jKohlj ). It was shown by Kohn jKohlj 
that under the condition Y(q) the Kohn Laplacian acting on (p, g)-forms is hypoelliptic with loss 
of one derivative. 

It was proved by Beals-Greiner s BC|j that for the Kohn Laplacian acting on (p, q)-ioims the 
condition (|1.8|) reduces to the condition Y(q), so we may apply Proposition 11.81 to recover Kohn's 
result. This allows us to complete the treatment of the Kohn in |BG| . because the initial argument 
there is not quite complete (see Remark l7.3|) . 

(c) Horizontal sublaplacian. The horizontal sublaplacian A& on a Heisenberg manifold (M d+1 ,H) 
can be seen as a horizontal Laplacian acting on the horizontal forms, that is on the sections of 
A^H* . This operator was first introduced by Tanaka |Taj for strictly pseudoconvex CR manifolds, 
but versions of this operator acting on functions were independently defined by Greenleaf |Gr| and 
Lee [L"e| . 
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While Aft acting on functions can be seen as a sum of squares up to lower order terms, it 
seems that little has been done concerning the hypoellipticity of A& acting on forms on a general 
Heisenberg manifolds, except in the contact case (see |Taj . |Ruj ) . 

We show here that the invertibility of the principal symbol of A& acting on the sections of A^H* 
reduces to a condition involving k and the Levi form of (M, H) only. More precisely, for a £ M let 
In be the rank of the Levi form C at a. We say that the condition X(k) is satisfied at a when 

(1.11) k g {n,n + l,...,d- n}. 

We then prove that this condition is the condition (|1.8|) for A& acting on A^H*. Thus, using 
Proposition II. HI we get: 

Proposition 1.9. Let A& : C°°(M,A^H*) — > C°°(M, A^H*) be the horizontal sublaplacian acting 
on horizontal forms of degree k. 

1) At a point x € M the Rockland condition for At> is equivalent to the condition X(k). 

2) The principal symbol of A& is invertible if, and only if, the condition X(k) is satisfied at every 
point. 

(d) Contact Laplacian. Given a contact manifold (M 2n+ , 9) the contact Laplacian is associated to 
the contact complex defined by Rumin |Ruj . Unlike the previous examples this not a sublaplacian 
and it is even of order 4 on contact forms of middle degrees. 

It has been shown by Rumin |Ruj that the contact Laplacian satisfies the Rockland condition 
on forms of any degree. Rumin then used results of Helffer-Nourrigat t HN3 to deduce that the 
contact Laplacian was hypoelliptic maximal. Alternatively, we may use Proposition 11.71 to deduce 
that on contact forms of any degree the contact Laplacian has an invertible principal symbol, hence 
admits a parametrix in the Heisenberg calculus and is hypoelliptic. 

1.5. Organization of the paper. The paper is organized as follows. In Section [21 we recall 
the main definitions and examples concerning Heisenberg manifolds and their tangent Lie group 
bundles. In Section 01 we give a detailed overview of the Heisenberg calculus of |BG| and Tay 
following closely the exposition of [B 



The section ^ is devoted to the definitions and the main properties of the principal symbols and 
model operators of f/fDO's. In Sectional we study the relationships between invertibility of the 
principal symbol, Rockland condition and hypoellipticity and, in particular, we prove Theorem ll.7l 

In Section El we deal with sublaplacians and in particular extend the results of |BG| to sublapla- 
cians acting on sections of vector bundles. In SectionEJwe deal with the invertibility of the principal 
symbols of main geometric operators on Heisenberg manifolds: Hormander's sum of squares, Kohn 
Laplacian, horizontal sublaplacian and contact Laplacian. In particular, we prove Proposition 11.91 

The last two sections are devoted to the proofs of Pr op osition 13 . 1 81 and Proposition 13.211 These 
are versions in Heisenberg coordinates of the invariance of the Heisenberg calculus by Heisenberg 
diffeomorphisms and transposition. The latter were proved in [EG] in a less precise form, but in this 
paper we need the precise version in Heisenberg coordinates in order to show that the definition 
of the principal symbol makes sense intrinsically and to determine the principal symbols of the 
transpose and the adjoint of a ^//DO. 

Acknowledgements. The author is grateful to the hospitality of the Mathematics Departments of 
Princeton University and Harvard University where most part of this paper was written. The 
research of the author was partially supported by the NSF grant DMS 0409005. 

2. Heisenberg manifolds and their tangent Lie group bundles 

In this section we recall the main facts about Heisenberg manifolds and their tangent Lie group 
bundle. The exposition here follows closely that of |Po2j . 



6 



Definition 2.1. 1) A Heisenberg manifold is a smooth manifold M equipped with a distinguished 
hyperplane bundle H C TM . 

2) A Heisenberg diffeomorphism 4> from a Heisenberg manifold (M,H) onto another Heisenberg 
manifold (M, H') is a diffeomorphism <f> : M —* M' such that = H' . 

Definition 2.2. Let (M d+1 ,H) be a Heisenberg manifold. Then: 

1) A (local) H -frame for TM is a (local) frame Xq,X±, . . . , ofTM so that X±, . . . , Xj span H . 

2) A local Heisenberg chart is a local chart together with a local H -frame ofTM over its domain. 

The main examples of Heisenberg manifolds are the following. 

(a) Heisenberg group. The (2n + l)-dimensional Heisenberg group H 2n+1 is M 2n+1 = K x R 2n 
equipped with the group law, 

(2.1) x.y=(x + y + ^ {xn+jVj ~ XjVn+j), x\ + yi, ■ ■ . ,x 2n + V2n)- 

l<3<n 

A left-invariant basis for its Lie algebra f) 2n+1 is provided by the vector- fields, 

( 2 - 2 ) Xo = l&> X i = 7i^ + Xn+ i7^r> Xn+ i = 7fT x i~£r> !<i<™, 

OXq OXj OXq OX n +j OXq 

which for j, k = 1, . . . , n and k ^ j satisfy the Heisenberg relations, 

(2-3) [Xj,X n+ f.] = —25jkX , [X ,Xj] = [Xj,Xk] = [X n+ j, X n+ k] = 0. 

In particular, the subbundle spanned by the vector fields X%, . . . , X2 n defines a left-invariant Heisen- 
berg structure on H 2n+1 . 

(b ) Foliations. A (smooth) foliation is a manifold M together with a subbundle T C TM which 
is integrable in the Froebenius' sense, i.e., we have [J 7 , J 7 ] C J- . Thus, any codimension 1 foliation 
is a Heisenberg manifold. 

(c) Contact manifolds. Opposite to foliations are contact manifolds: a contact structure on a 
manifold M 2n+1 is given by a global non-vanishing 1-form 6 on M such that d6 is non-degenerate 
on H = ker#. In particular, (M,H) is a Heisenberg manifold. In fact, by Darboux's theorem 
any contact manifold (M 2n+1 ,6) is locally contact-diffeomorphic to the Heisenberg group H 2n+1 
equipped with its standard contact form 9° = dxo + ^j=i( x j^ x n+j — x n+jdxj). 

(d) Confoliations. According to Elyashberg-Thurston |ETj a confoliation structure on an oriented 
manifold M 2n+1 is given by a global non-vanishing 1-form 9 on M such that (d9) n A 9 > 0. In 
particular, when (d9) n A9 = (resp. (d9) n A9 > 0) we are in presence of a foliation (resp. a contact 
structure). In any case the hyperplane bundle H = ker# defines a Heisenberg structure on M. 

(e) CR manifolds. A CR structure on an orientable manifold M 2n+1 is given by a rank n complex 
subbundle T\$ C T^M which is integrable in Froebenius' sense and such that T^o n Tq^ = {0}, 
where Tq^i = Ti$. Equivalently, the subbundle H = 5ft(Ti 5 o <8> ^b,i) nas the structure of a complex 
bundle of (real) dimension 2n. In particular, the pair (M, H) forms a Heisenberg manifold. 

Moreover, since M is orientable and H is orientable by means of its complex structure, the 
normal bundle TM/H is orientable, hence admits a global nonvanishing section T. Let 9 be the 
global section of T*M/H* such that 9{T) = 1 and 9 annihilates H. Then Kohn's Levi form is the 
form Lq on T\$ such that, for sections Z and W of T^o, we have 

(2.4) L e (Z, W) = -id9(Z, W) = i9{[Z, W}). 

We say that M is strictly pseudoconcex (resp. nondegenerate, K-strictly pseudoconvex) when 
for some choice of 9 the Levi form Lg is everywhere positive definite (resp. is everywhere non- 
degenerate, has everywhere signature (n — k, k, 0)). In particular, when M is nondegenerate the 
1-form 9 is a contact form on M. 
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The main example of a CR manifold is that of the (smooth) boundary M = dD of a complex 
domain D C C™. In particular, when D is strongly pseudoconvex (or strongly pseudoconcave) M 
is strictly pseudoconvex. 

2.1. The tangent Lie group bundle. A simple description of the tangent Lie group bundle of a 
Heisenberg manifold (M d+1 , H) can be given as follows. 

Lemma 2.3 ( |Po2j ). The Lie bracket of vector fields induces 2-form, 

(2.5) £ : H x H — ► TM/H, 

such that, for any a G M and any sections X and Y of H near a, we have 

(2.6) C a (X(a),Y(a)) = [X,Y](a) mod H a . 

Definition 2.4. The 2-form C is called the Levi form of (M,H). 

The Levi form C allows us to define a bundle qM of graded Lie algebras by endowing (TMj H)®H 
with the smooth fields of Lie Brackets and gradings such that 

(2.7) [X + X',Y + Y'] a = C a (X',Y') and t.(X + X') = t 2 X + tX' , t G R, 
for a G M and X , Y in T a M/H a and X', Y' in H a . 

Definition 2.5. The bundle qM is called the tangent Lie algebra bundle of M . 

As we can easily check qM is a bundle of 2-step nilpotent Lie algebras which contains the normal 
bundle TM/H in its center. Therefore, its associated graded Lie group bundle GM can be described 
as follows. As a bundle GM is (TM/H)®H and the exponential map is the identity. In particular, 
the grading of GM is as in (|2.7I) . Moreover, since qM is 2-step nilpotent the Campbell-Hausdorff 
formula gives 

(2.8) (expX)(exp Y) = exp(X + Y+-[X,Y]), X, Y sections of qM. 
From this we deduce that the product on GM is such that 

(2.9) (X + X').(Y + X') = X + Y + \H{X'X) + X' + Y', 
for sections Xq, Yq of TM/H and sections X' , Y' of H. 

Definition 2.6. The bundle GM is called the tangent Lie group bundle of M . 

In fact, the fibers of GM are classified by the Levi form C as follows. 

Proposition 2.7 ( |Po2j ) . 1) Let a G M. Then C a has rank 2n if, and only if, as a graded Lie 
group G a M is isomorphic to H 2n+1 x M d_2n . 

2) The Levi form C has constant rank 2n if, and only if, GM is a fiber bundle with typical fiber 
M 2n+l x K d-2n 

Now, let (j) '■ (M,H) — > (M',H') be a Heisenberg diffeomorphism from (M,H) onto another 
Heisenberg manifold (M',H'). Since 4>*H = H' we see that (ft' induces a smooth vector bundle 
isomorphism 1ft : TM/H -> TM'/H'. 

Definition 2.8. We let cft' H : {TM/H)®H -> (TM' /H')@H' denote the vector bundle isomorphism 
such that 

(2.10) <ft' H (a)(X + X') = $(a)X + <ft'[a)X', 
for any a G M and any Xq G T a /H a and X' G H a . 

Proposition 2.9 f |Po2j ). The vector bundle isomorphism (ft' H is an isomorphism of graded Lie 
group bundles from GM onto GM' . In particular, the Lie group bundle isomorphism class of GM 
depends only on the Heisenberg diffeomorphism class of (M, H) . 
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2.2. Heisenberg coordinates and nilpotent approximation of vector fields. It is interesting 
to relate the intrinsic description of GM above with the more extrinsic description of BG] (see 
also |Bej . jEMMj . FS| , |Groj . |Ro2j ) in terms of the Lie group associated to a nilpotent Lie algebra 
of model vector fields. 

First, let a € M and let us describe a M as the graded Lie algebra of left-invariant vector fields 
on G a M by identifying any X € Q a M with the left-invariant vector fields Lx on G a M given by 

(2.11) L x f(x) = |/[(iex P X)4 t=0 = j t f[(tX).x] u=0 , f e C°°(G a M). 

This allows us to associate to any vector fields X near a a unique left-invariant vector fields X a on 
G a M such that 

C2 12) x a = { Lx °( a ) if X ^ ^ Ha ' 

\ Lx( a ) otherwise, 

where Xq(o) denotes the class of X(a) modulo H a . 

Definition 2.10. The left-invariant vector fields X a is called the model vector fields of X at a. 

Let us look at the above construction in terms of a //-frame Xq, . . . ,X d near a, i.e. of a local 
trivialization of the vector bundle (TM/H) © H. For j, k = 1, . . . , d we let 

(2.13) C(Xj ,X k ) = [Xj , X k ]X = L jk X mod H. 

With respect to the coordinate system (xo, • • • ,Xd) — > xqXq(u) + . . . + x^X^a) we can write the 
product law of G a M as 

1 d 

(2.14) x.y = (x + - Lj k XjX k ,xt, . . .,x d ). 

j,k=i 



Then the vector fields Xj, j = 0, . . . ,d, in ()2.12j) are the left-invariant vector fields corresponding 
to the vectors ej, j = 0, . . . , d, of the canonical basis of ]R d+1 , i.e., we have 

(2.15) X 5 = JL and X;= A_ l£ Ljm A. 

J k=l 

In particular, for j, k = 1, . . . , d we have the relations, 

(2.16) [X?, Xt\ = L jk (a)X$, [Xf, X$] = 0. 

Now, let k : domn — > U be a Heisenberg chart near a = k _1 (u) and let Xq, . . . , X^ be the 
associated H- frame of TU. Then there exists a unique affine coordinate change x — > ip u ( x ) such 
that ip u (u) = and ip u ^Xj{{)) = for j = 0, 1, . . . , d. Indeed, if for j = 1, . . . , d we set Xj(x) = 

Yl=o B jk{x)^ then we have 

(2.17) iP u {x)=A{u){x-u), A(u) = (B(u) t )- 1 . 

Definition 2.11. 1) The coordinates provided by tp u are called the privileged coordinates at u with 
respect to the H -frame Xq, . . . , X^. 

2) The map ip u is called the privileged- coordinate map with respect to the H -frame Xq, . . . , Xd- 



Remark 2.12. The privileged coordinates at u are called it-coordinates in jBGj . but they correspond 
to the privileged coordinates of |Bej and |Groj in the special case of a Heisenberg manifold. 

Next, on R d+1 we consider the dilations 

(2.18) 5 t (x) = t.x = (t 2 xo,txi, . . . ,tx d ), teR, 
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with respect to which J^— is homogeneous of degree —2 and J^—, . . . , J^— is homogeneous of de- 
gree —1. 

d_ 



Since in the privileged coordinates at u we have Xj(0) = we can write 

(2.19) Xj = — + J2 a jk{x)—, j = 0,l,...d, 

where the ajfc's are smooth functions such that GUfc(O) = 0. Therefore, we may define 

(2.20) Xi u) = llmt 2 S* t X = 4- 



A , d 



(2.21) Xf ] = Jim r^Xj = 7r + Y J b J^k^-, j = l,...,d, 

where for j, k = 1, . . . , d we have set = ^ a j0 (0) • 

Observe that Xq"^ is homogeneous of degree —2 and XJ U) ,...,X^ are homogeneous of degree 
— 1. Moreover, for j,k = 1, . . . , d we have 

(2.22) [xj"U<">] = and [xf\ X™] = (b kj - b jk )X^ . 

Thus, the linear space spanned by X^ u) , x[ u) X { d u) is a graded 2-step nilpotent Lie algebra g^' . 
In particular, q( u ' is the Lie algebra of left-invariant vector fields over the graded Lie group 
consisting of M. d+1 equipped with the grading (|2.18|) and the group law, 

d 

(2.23) x.y = (x + ^2 hjXjX k ,x 1 , . . . ,x d ). 

j,k=i 

Now, if near a we let C(Xj,X k ) = [Xj, X k ] = Lj k (x)Xo mod H, then we get 

(2.24) [Xf\x^] = \Mt5lX v t5lX k ] = \mit 2 5* t (L jk {oK-\x))X G ) = L jk {a)X^ . 

j t — >u t — >u 

Comparing this with (|2.16|) and (|2.22j) then shows that has the same the constant structures 
as those of Q a M, hence is isomorphic to it. Consequently, the Lie groups and G a M arc 
isomorphic. In fact, as shown in |BG| and |Po2j . an explicit isomorphism is given by 

1 d 

(2.25) (j) u (x ,...,x d ) = (x - - 22 (bjk + hj)xjX k ,X!, . . . ,x d ). 

j,k=i 

Definition 2.13. Let e u = <p u o ip u . Then: 

1 ) The new coordinates provided by e u are called Heisenberg coordinates at u with respect to the 
H -frame X ,...,X d . 

2) The map e u is called the u-Heisenberg coordinate map. 



Remark 2.14. The Heisenberg coordinates at u have been also considered in |BCj as a technical 
tool for inverting the principal symbol of a hypoelliptic sublaplacian. 

Next, by |Po21 Lem. 1.17] we have 
(2.26) 4J$> = £. = X§ and <^xf = ^ - \ J2 L = X}, j 1 <l. 



k=l 







Since (f) u commutes with the Heisenberg dilations (|2.18[) . using (J2.2Uj) - ()2.21)) we get 
(2.27) limt 2 ^*^ = X o and lim^*0 u *xf } = X a , j = l,...,d. 
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In fact, as shown in Po2 , in Heisenberg coordinates at a for any vector fields X as t — > we 
have 

, 99S x x* y / t~ 2 X a + 0{t~ l ) HX(a)eH a , 

[Z ' Zii) °* A ~ \ t- l X a + 0(l) otherwise. 

Therefore, we obtain: 



Proposition 2.15 ( Po2 |). In the Heisenberg coordinates centered at m = k the tangent Lie 
group G a M coincides with and for any vector fields X the model vector fields X a approximates 
X near a in the sense of 



One consequence of the equivalence between the two approaches to GM is a tangent approxi- 
mation for Heisenberg diffeomorphisms as follows. 

Let 4> '■ {M, H) — » (M', H') be a Heisenberg diffeomorphism from (M, H) to another Heisenberg 
manifold (M',H'). We also endow IR rf+1 with the pseudo-norm, 

(2.29) \\x\\ = {xl + {xi + ... + x 2 d f) l l\ xeR d+1 , 
so that, for any x 6 M. d+1 and any i £ R, we have 

(2.30) ||t.sc|| = \t\ \\x\\. 

Proposition 2.16 f |Po2l Prop. 2.21]). Let a € M and set m! = 4>(a). Then, in Heisenberg 
coordinates at a and at a' the diffeomorphism (j)(x) has a behavior near x = of the form 

(2.31) cf>(x) = 4' H (0)x + (0(||x|| 3 ), 0(||x|| 2 ), . . . , 0(||^|| 2 )). 

In particular, there are no terms of the form XjX^, 1 < j,k < d, in the Taylor expansion of (f>o(x) 
at x = 0. 

Remark 2.17. An asymptotics similar to (|2.31|) is given in |Bel Prop. 5.20] in privileged coordinates 
at u and v! = Ki(a'), but the leading term there is only a Lie algebra isomorphism from onto 
q( u '\ This is only in Heisenberg coordinates that we recover the Lie group isomorphism 4>' H (a) as 
the leading term of the asymptotics. 

3. Hypoelliptic calculus on Heisenberg manifolds 

The Heisenberg calculus is the relevant pseudodifferential tool to study hypoelliptic operators 
on Heisenberg manifolds. It was independently invented by Beals-Greiner |BGj and Taylor |Tay| , 
extending previous works of Bout et de Monvel |BoT] , Folland-Stein [FS] and Dynin ( |DyT1 , |Dy2| ) 
(see also (ESH], |CGGP| . |EMMj . |Gnj . [Ho3j, jESl]). 

The idea in the Heisenberg calculus is to have a pseudodifferential calculus on a Heisenberg mani- 
fold (M , H) which is modeled at any point a £ M by the calculus of left-invariant pseudodifferential 
operators on the tangent group G a M. 

3.1. Left-invariant pseudodifferential operators. Let (M d+l ,H) be a Heisenberg manifold 
and let G = G a M be the tangent Lie group of M at a point a G M. We recall here the main facts 
about left-invariant pseudodifferential operators on G (see also |BG| . |GGGP| . |Tay| ) . 

Recall that for any finite dimensional vector space E the Schwartz class S{E) is a Frechet space 
and the Fourier transform is the continuous isomorphism of S{E) onto S(E*) given by 

(3.1) /(e) = / e i ^f{x)dx, feS(E), UE*, 

Je 

where dx denotes the Lebesgue measure of E. 

Definition 3.1. Sq(E) is the closed subspace of S{E) consisting of f G S{E) such that for any 
differential operator P on E* we have (Pf)(0) = 0. 
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Since G has the same underlying set as that of its Lie algebra g = Q X M we can let S(G) and 
Sq(G) denote the Frechet spaces S(E) and Sq(E) associated to the underlying linear space E of g 
(notice that the Lebesgue measure of E coincides with the Haar measure of G since G is nilpotent). 

Next, for AgR and £ = £o + £' hi g* = (T*M/H*) H a we let 

(3.2) A .£ = A.(£ + O = A% + A£'. 

Definition 3.2. S m (g*), m G C, is the space of functions p G C°°(q* \ 0) which are homogeneous 
of degree m, in the sense that, for any A > we have 

(3.3) p(A.6 = A m p(C) V£G0*\C). 

In addition S m (g*) is endowed with the Frechet space topology induced from that of C°°(g* \ 0). 

Note that the image 5o(G) of S(G) under the Fourier transform consists of functions v G 5(g*) 
such that, given any norm |.| on G, near £ = we have = 0(|£| ) for any integer N > 0. 

Thus, any p G S m (g*) defines an element of 5o(g*)' by letting 

(3-4) { P ,g)= [ p(0g(m, 9 G <W)- 

J s * 

This allows us to define the inverse Fourier transform of p as the element p £ Sq(G)' such that 

(3-5) (P,f) = {pJ) V/eSb(G). 

Proposition 3.3 ( BG , CGGP ). 1) For any p G 5 m (g*) i/ie left- convolution by p, 

(3-6) p * f{x) := (p(y), /(x.y- 1 )}, / G 5 (G), 

defines a continuous endomorphism ofSo(G). 
2) There is a continuous bilinear product, 

(3.7) * : S mi (g*) x S m2 (Q*) — > S mi+m2 (Q*), 

such that, for any pi G S mi (g*) and p2 G S m2 (Q*), the composition of the left- convolution operators 
by pi and p2 is the left- convolution operator by {p\ *P2) y , that is, we have 

(3.8) pi * (p 2 * /) = (pi * p 2 ) v * / V/ G 5b (G). 

Let us also mention that if p G S m (g*) then the convolution operator Pu = p * / is a pseudodif- 
ferential operator. Indeed, let Xo(a), . . . , X^(a) be a (linear) basis of g so that Xo(a) is in T a M/H a 
and Xi(a), . . . , X<i{a) span ff a . For j = 0, . . . , d let Xj be the left-invariant vector fields on G such 

that Xjj 1 _ q = Xj(a). The basis Xo(a), . . . ,X^(a) yields a linear isomorphism g ~ hence a 

global chart of G. In this chart p is a homogeneous symbol on R d+1 \ with respect to the dilations 

(3.9) X.x = (X 2 x ,Xx 1 ,...,Xx d ), x£R d+1 , A > 0. 

Similarly, each vector fields jXj, j = 0,...,d, corresponds to a vector fields on whose 
symbol is denoted <7"(x, £). Then, setting a = (ao, . . . , ad), it can be shown that in the above chart 
the operator P is given by 

(3-10) Pf{x)=f e ix M^(x,0)f(0, f£S (R d+1 ). 

In other words P is the pseudodifferential operator p(— iX a ) := p(o~ a (x,D)) acting on 5o(M d+1 ). 
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3.2. ^hDO's on an open subset of R d+1 . Let U be an open subset of R d+1 together with a 
hyperplane bundle H C TU and a ff-frame X$, X\, . . . , Xd of TU. Then the class of f/fDO's on 
U is a class of pseudodifferential operators modelled on that of homogeneous convolution operators 
on the fibers of GU. 

Definition 3.4. S m (U x R d+1 ), m G C, is the space of symbols p(x,£) G C°°(U x K d+1 \0) that 
are homogeneous of degree m with respect to the ^-variable, that is, 

(3.11) p(x, A.f ) = X m p(x, £) for any A > 0, 

where £ — > A.£ denotes the Heisenberg dilation \3. 9i) . 

Observe that the homogeneity of p G S m (U x R rf+1 ) implies that, for any compact K C U, it 
satisfies the estimates 

(3.12) |^fp(x,OI<^||^f m -^, x £ K, e^O, 
where = (|£ | 2 + |£i| 4 + • • • + |^| 4 ) 1/4 and (q) = 2a + a x + . . . + a d . 

Definition 3.5. S m (U x R d+1 ) ; m£C, consists of symbols p G C°°(U x R rf+1 ) wrai/i an asymptotic 
expansion p ~ J2j>oP' m -j > P k e x I^ rf+1 ), mi fie sense t/iai, /or any integer N and for any 

compact K C U , we have 

(3.13) |3?5f(p- £jW-i)0c,O| < C^ll^f m - < ^- JV , x £ K, U\\ > 1. 

Next, for j = 0, ...,d let cr.,(x,£) denote the symbol of iX,- (in the classical sense) and set 
<7 = (<To, • • • , (Td). For any p G S m (U xR rf+1 ) it can be shown that the symbol p a (x, £) := p(x, <r(x, £)) 
is in the Hormander class of symbols of type tj) (see |BG1 Prop. 10.22]). Therefore, we define a 
continuous linear operator from C^°(U) to C°°(U) by letting 

(3.14) p(x,-iX)f(x) = (2tt)-^ J e^p(x,o-(x,0)f(Odti, f G C^)- 

In the sequel we let ^ /_00 ([/) denotes the class of smoothing operators, i.e. of operators given by 
smooth kernels. 

Definition 3.6. *g(J7)» meC, consists of operators P : C™{U) -> C°°(C7) o/ the form 

(3.15) P = p(x,-iX) + R, 

with p in S m {U x R d+1 ), called the symbol of P, and with R in ty~°°(U). 

The above definition of the symbol of P differs from that of |BG| . since there the authors defined 
it to be p<j(x, £) = p(x,a(x,£)). Note also that p is unique modulo S~°°(U x R d+1 ). 

Lemma 3.7. For j = 0,1,... let p m _j G S m _j(U x R d+1 ). Then there exists P G Vjj(U) with 
symbol p ~ ^2j>oPm-j- Moreover, the operator P is unique modulo smoothing operators. 

The class ^^(U) does not depend on the choice of the H- frame Xq, . . . , Xd (see |BG1 Prop. 10.46]). 
Moreover, since it is contained in the class of fDO's of type ^) we get: 

Proposition 3.8. Let P be a \I/ rDO of order m on U . 

1) P extends to a continuous linear mapping from £'{U) to V(U) and has a distribution kernel 
which is smooth off the diagonal. 

3) Let k = 5ftm if film > and k = ^fiim otherwise. Then for any s G R the operator P G ^^(U) 
extends to a continuos mapping from L 2 scorap {U) to L 2 s _ kXoc (U). 
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3.3. Composition of ^hDO's. Recall that there is no symbolic calculus for fDO's of type (J, |) 
since the product of two such $DO's needs not be again a ^DO of type |). However, the fact 
that the ^/^DO's are modelled on left-invariant pseudo differential operators allows us to construct 
a symbolic calculus for f//DO's. 

(x) 

First, for j = 0, . . . , a let X- be the leading homogeneous part of Xj in privileged coordinates 
centered at x defined according to l|2.2U|) - Q2.21JI . These vectors span a nilpotent Lie algebra of left- 
invariant vector fields on a nilpotent graded Lie group G x which corresponds to G X U by pulling 
back the latter from the Heisenberg coordinates at x to the privileged coordinates at x. 

As alluded to above the product law of defines a convolution product for symbols, 

(3.16) *<*) : 5 mi (R d+1 ) x S m2 (R d+1 ) — ► S mi+m2 (R d+1 ). 
such that, with the notations of ()3.1Uj) . on £(5o(M d+1 )) we have 

(3.17) Pl (-ixW)p 2 (-ixW) = (px *W p 2 )(-iX^) y Pj G S mj (R d+1 ). 

As it turns out the product *( x ' depends smoothly on x (see |BG1 Prop. 13.33]). Therefore, we 
get a continuous bilinear product, 

(3.18) * : S mi (U x R d+1 ) x S m . 2 (U x R d+1 ) - 5 mi+m2 (C7 x M d+1 ), 

(3.19) Pi*p 2 ^,0 = (Pi(^-)* (z) P 2 (x,.))(0, PieS mj .(f/xE w ). 

Proposition 3.9 ([ESI Thm. 14.7]). For j = 1,2 Zet Pj G tf^(17) We symbol Pj ~ ^jfc>o Pj>y-* 
and assume that one of these operators is properly supported. Then the operator P = P\P 2 is a 
^fffDO of order m\ + m 2 and /ias symbol p ~ X]fc>oPmi+m2-fc> 

(k— fei— fca) 

(3.20) p mi+m2 _ fc (x,£) = ^ ^ ^a/37«(»)(-0|pi,mi-Jfei) * (Cd^d^p 2 ,m 2 -k 2 )(x, 0, 
(0 

where ^ denotes the sum over the indices such that \j3\ = and \a\ + |/3| < (6^ — (y) + (6) = Z, 

a/375 

and iae functions h a p 7 g(x) 's are polynomials in the derivatives of the coefficients of the vector fields 
Xq, . . . , X d . 

3.4. The distribution kernels of \I/hDO's. An important fact about $DO's is their character- 
ization in terms of their distribution kernels. 

First, we extend the notion of homogeneity of functions to distributions. For K G ^(M^" 1 " 1 ) and 
for A > we let K\ denote the element of ^(M^" 1 " 1 ) such that 

(3.21) (K x J) = \-^ 2 HK(x),f(\- 1 .x)) V/6 5(l d+1 ). 

In the sequel we will also use the notation K(X.x) for denoting K\(x). We then say that K is 
homogeneous of degree m, m G C, when K\ = \ m K for any A > 0. 

Definition 3.10. S' reg (R d+1 ) consists of tempered distributions on R d+1 which are smooth outside 
the origin. We equip it with the weakest topology such that the inclusions of S' reg (R d+1 ) into S'(R d+1 ) 
and C oc (M d+1 \0) are continuous. 

Definition 3.11. K m (U x R d+1 ), m G C, consists of distributions K(x,y) in C 00 (U)^)S' reg (R d+1 ) 
such that for some functions c a (x) G C°°(U), (a) = m, we have 

(3.22) K(x, X.y) = X m K(x, y) + A m log A ^ c a (x)y a for any A > 0. 

(a)=m 

The interest of considering the distribution class K. m (U x M d+1 ) stems from: 
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Lemma 3.12 (\BU[ Prop. 15.24], [HMl Lem. 1.4]). 1) Any p G S rn (UxR d+1 ) agrees onUx(R d+1 \0) 
with a distribution t(x,() G C°°(U)®S' (M. d+1 ) such thatf^ y is in K^U xR d+1 ) , rh = -(m+d+2). 
2) If K(x,y) is in Krh{U x R d+l ) then the restriction of K y ^(x,£) to U x (R d+1 \0) belongs to 

This result is a consequence of the solution to the problem of extending a homogeneous function 
p G C°°(R d+1 \ 0) into a homo geneous distribution on R d+1 and of the fact that for r G iS^IR^" 1 " 1 ) 
we have 

(3.23) (f) x = |A|- (d+2) (r A -i) A VA G M \ 0. 

In particular, if r is homogeneous of degree m then f is homogeneous of degree — (m + d + 2). 
The relevant class of kernels for the Heisenberg calculus is the following. 

Definition 3.13. K, m (U x R d+1 ), m G C, consists of distributions K G V'(U x R d+1 ) with an 
asymptotic expansion K ~ J2j>o Km+j > K\ G K.i{U x R d+1 ), m i/ie sense i/iai, /or any integer N , 
as soon as J is large enough we have 

(3.24) K - ^ K m+j (£C N (Ux R d+1 ). 

j<J 

Since under the Fourier transform the asymptotic expansion ()3.13|) for symbols corresponds to 
that for distributions in (|3.24[) . using Lemma 13.121 we get: 

Lemma 3.14 ( [EHl pp. 133-134]). Let K G V(U x R d+l ). Then the following are equivalent: 

(i) The distribution K belongs to K, m {U x R d+1 ); 

(ii) We can put K into the form 

(3.25) K(x, y) = p^ y (x, y) + R(x, y), 

for some P eS™((Jx R d+1 ), rh = -(m + d + 2), and some ReC°°(U x R d+1 ). 

Moreover, if (i) and (ii) holds and we expand K ~ Sj>o Km+j> Kl ^ K-i{U x R d+1 ), then we have 
P ~ J2jX)P™-j w ^ ere Prh-j G S*-j(U x R d+1 ) is the restriction to U x (R d+1 \0) of (K m+j )* 

Next, for x G U let ifi x denote the affine change to the privileged coordinates at x and let us 
write (^4*) -1 ^ = a(x,£) with A x G GL^ + i(IR). Since ip x (x) = an d ip x *Xj = at y = for 
j = 0, . . . ,d, one checks that tp x (y) = A x (y — x). 

Let p G S m (U x R d+1 ). As p(x,-iX) = p a (x,D) with p a {x,0 = p(x t a(x,{)) = p(x, (>4* 
the distribution kernel k p ( x -ix)( x ,y) of p(x, —iX) is represented by the oscillating integrals 

(3.26) (2vr)-( d+1 ) / e iix - y) ^p{x, (Aly 1 ^ = (27r)-^\A x \ [ e iAx(x - y) ^p{x,^. 



Since ijj x (y) = A x {y — x) we deduce that 

(3-27) k p (x,-iX){x,y) = \ijj' x \p^y(x,-il) x (y)). 

Combining this with Lemma 13.141 then gives: 

Proposition 3.15 ( BG, Thms. 15.39, 15.49]). Let P : C™{U) -> C°°(U) be a continuous linear 
operator with distribution kernel kp(x,y). Then the following are equivalent: 

(i) P is a ^hDO of order m, m G C. 

(ii) There exist K G K^(U x R d+1 ), rh = -(m + d + 2), and ReC°°(U x U) such that 
(3.28) k P (x,y) = \iP' x \K(x, ~i> x (y)) + R(x, y). 

Furthermore, if (i) and (ii) hold and K ~ ^2j>o^-ih+j? K\ G ^l{U X then P has symbol 

p ~ J2j>oPm-j, Pi G Si(U x R d+1 ), where 

Pm—j IS 

the restriction to U x (M d+1 \0) of (K m+ j)*c- 
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In the sequel we will need a version of Proposition 13. 151 in Heisenberg coordinates. To this end 
let e x denote the coordinate change to the Heisenberg coordinates at x and set <f> x = e x o i/j^ 1 . 
Recall that <p x is a Lie group isomorphism from to G X U such that (f> x (X.y) = X.(j> x (y) for any 
A € R. Moreover, using (|2.25|) one can check that \(p' x \ = 1 and 4>~ 1 (y) = —cj) x (—y). Therefore, 
from (|3.27l) we see that we can put k p ( x _ iX )(x,y) into the form 

(3.29) k p{x _ iX) {x,y) = \e' x \K P (x,-e x {y)), K P (x,y) = p£-> y (x, -<p x {-y)) = p£-> y (x, fa 1 (y)). 
In fact, the coordinate changes 4> x give rise to an action on distributions on U x R d+1 given by 

(3.30) K(x,y) — > <j>* x K(x,y), <f>* x K(x,y) = K(x, </>-\y)). 

Since <fr x depends smoothly on x, this action induces a continuous linear isomorphisms of C N (U x 
R rf+1 ), N > 0, and C°°(U x R rf+1 ) onto themselves. As 4> x (y) is polynomial in y in such way that 
<Ae(0) = and 4> x {X.y) = \.(/> x (y) for every A G R, we deduce that the above action also yields a 
continuous linear isomorphism of C°° (U)(g>S' rcg (M. d+1 ) onto itself and, for every A > 0, we have 

(3.31) (4>* x K)(x,X.y) = 4>* x [K(x,X.y)}, K G V'{U x R d+1 ). 

Furthermore, as <j> x {y) is polynomial in y we see that for every a € N d+1 we can write 4> x (y) a 
in the form cj) x (y) a = E®=$ d ap{x)^ with d afi G C°°(U x R d+1 ). It then follows that, for 
every m G C, the map K(x,y) — > (ff x K(x,y) induces a linear isomorphisms of JC m (U x R d+1 ) and 
IC m (U x R d+1 ) onto themselves. Combining this with (|3.29|) and Proposition 13. 151 then gives: 

Proposition 3.16. Let P : C£°(J7) — > C°°(U) be a continuous linear operator with distribution 
kernel kp(x,y). Then the following are equivalent: 

(i) P is a ^ hDO of order m, m G C. 

(ii) There exist K P G K7 n (U x R d+1 ), rh = -(m + d + 2), and R G C°°(U x U) such that 

(3.32) k P (x, y) = \e' x \K P (x, -e x {y)) + R(x, y). 

Furthermore, if (i) and (ii) hold and Kp ~ Sj>o ^P,m+j > Ki £ K-i(U x R d+1 ), then P has 
symbol p ~ Ylj>oPm-j , Pi G Si(U x R d+1 ), where p m -j is the restriction to U x (R d+1 \0) of 

[Kp^+jix^-Hy))}^. 

Remark 3.17. Let a G U. Then (|3.32|) shows that the distribution kernel of P = (e a )*P at x = 
is 

(3.33) k p (0,y) = \e' a \- 1 kp{e- 1 ^),e- 1 (y)) = K P {a-y). 

Moreover, as we are in Heisenberg coordinates already, we have ipo = Eq = 4>q = id. Thus, in the 
form (|3,32j) for P we have Kp(0,y) = Kp(a,y). Therefore, if we let p m (x,^) denote the principal 
symbol of P and let Kp^h G JCrh{U xR d+1 ) denote the leading kernel of Kp, then by Proposition ^, lbl 
we have 

(3.34) Pm(0,0 = [Kp,rh]^(a,0- 

This shows that [-K"p,m]y_j.£ ifli £) is the principal symbol of P at x = in Heisenberg coordinates 
centered at a. 

3.5. 'I'hDO's on a general Heisenberg manifold. Let (M d+1 ,H) be a Heisenberg manifold. 
As alluded to before the f^/DO's on an subset of R d+1 are fDO's of type (|, |). However, the 
latter don't make sense on a general manifold, for their class is not preserved by an arbitrary change 
of chart. Nevertheless, when dealing with f/;DO's this issue is resolved if we restrict ourselves to 
changes of Heisenberg charts. Indeed, we have: 
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Proposition 3.18. Let U (resp. U) be an open subset o/lR d+1 together with a hyperplane bundle 
H CTU (resp. H C TU) and a H -frame of TV (resp. a H -frame ofTU). Let <f> : (U, H) -> (U, H) 
be a Heisenberg diffeormorphism and let P G ^^(U). 

1) The operator P = (p*P is a *S>hDO of order m on U. 

2) If the distribution kernel of P is of the form h'J.'J2\) with Kp(x,y) G K™(U x M d+1 ) then the 
distribution kernel of P can be written in the form VJ.32]) with Kp(x,y) G IC m (U x such that 

(3.35) K P (x,y)~ £ ^a a p(x)y^(a§Kp)(<l>(x),<j> , H (x)y), 

where we have let a aj3 (x) = d^[\d y (e^ o ( f ) oe~ 1 )(y)\(e^ x ) o ( j ) oe~ 1 {y) - <f>' H (x)y) a ]\ y=0 and denote 
the change to the Heisenberg coordinates at x G U . In particular, we have 

(3.36) K P (x,y) = \ ( f>' H (x)\K p ^(x)^' H (x)y) mod /C™ +1 (£7 x R d+1 ). 

Remark 3.19. The version of the above statement in iBGj does not contain the asymptotics ()3.36j) . 
which will be crucial for giving a global definition of the principal symbol of a 'I'hDO in the next 
section. For this reason give a detailed proof of the above version in Section |H| This proof will also 
be useful in |Po3j and |Po4j for generalizing Proposition 13.181 to holomorphic families of $//DO's 
and to ^/fDO's with parameter. 

As a consequence of Proposition 13.181 we can define f^DO's on M acting on the sections of a 
vector bundle £ over M. 

Definition 3.20. ^(M,£), m G C, consists of continuous operators P : C™(M,£) -> C°°(M,£) 
such that: 

(i) The distribution kernel of P is smooth off the diagonal; 

(ii) For any trivialization r : £\ u — » U xC r over a local Heisenberg chart k : U — > V C M. d+1 the 
operator k*t*Ip\ v ) belongs to ^(V,C r ) ■= ^h( V ) ® EndC r . 

All the previous properties of $DO's on an open subset of R d+1 hold mutatis standis for $^DO's 
on M acting on sections of £ . 

3.6. Transposes and adjoints of vI/hDO's. Let us now look at the transpose and adjoints of 
$gDO's. First, given a Heisenberg chart U C M. d+1 we have: 

Proposition 3.21. Let P G Then: 

1) The transpose operator P* is a ^ hDO of order m on U . 

2) If we write the distribution kernel of P in the form VS. 32^1 with Kp G K m (U x R d+1 ) then P l 
can be written in the form \3.32]) with K P t G 10^(17 x R d+1 ) such that 

(3.37) K pt (x,y)~ £ £ a a ^(x)/ +5 (d^^ P )(x, -y), 

§<o)<® |7|<I<5|<2| 7 | 

where a aPlS {x) = ^r^\dy{\e' £ - 1{ _ y) \{y - e £ -i [y) {x)) a )d 5 y {e~ l {-y) - x) 7 ](x,0). In particular, 

(3.38) K P t(x,y) = K P (x,-y) mod /C™ +1 (£7 x R d+1 ). 

Remark 3.22. The asymptotic expansion ()3.37j) is not stated in BG], but we need it in order to 
determine the global principal symbol of the transpose of a ^//DO (see next section). A detailed 
proof of Proposition 13.211 can be found in Sectional 

Using this result, or its version in |B(irj . we obtain: 
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Proposition 3.23 (jBUl Thm. 17.4]). Let P : C°°(M,£) -» C°°(M, £) be a ^ H D0 of order m. 
Then: 

1) The transpose operator P t : S'(M, £*) -» V(M, £*) is a ^ hDO of order m; 

2) If ' M is endowed with a smooth positive density and £ with a Hermitian metric then the adjoint 
operator P* : C°°(M, £) -» C°°(M,£) is a ^ H DO of order m. 

4. Principal symbol and model operators. 

In this section we define the principal symbols and model operators of f^DO's and check their 
main properties. 

4.1. Principal symbol and model operators. Let q*M be the dual bundle of qM with canonical 
projection 7r : g*M — > M. 

Definition 4.1. S m (g*M,£), m G C, is the space of sections p G C°°(q*M \ 0, End ir*£) which are 
homogeneous of degree m in the sense that, for any A > 0, we have 

(4.1) p(x, A.£) = X m p(x, V(x, G g*M \ 0, 
where £ — > A.^ denotes the dilation \3. 2)) . 

Let P G fyfl(M) and for j = 1,2 let fiy be a Heisenberg chart with domain Vj C M and let 
: U\ — > XJi be the corresponding transition map, where we have let Uj = Kj {V\ D V2) C 

Let us first assume that £ is the trivial line bundle, so that P is a scalar operator. For j = 1,2 
we let Pj := Kj*(P\ v nV )i so that Pi = 4>*P2- Since Pj belongs to ^>^{Uj) its distribution kernel is 
of the form (l3~32l with K P . G KJ^ilJj x R d+1 ). Moreover, by Proposition ETT81 we have 

(4.2) Kp 1 (x, y) = \ ( f>' H (x)\K P2 ( ( f>(x), ( f>' H (x)y) mod/C™ +1 ([/i x R d+1 ). 
Therefore, if we let K P .^ G fCrh{Uj x M^ 1 ) be the leading kernel of Kp j then we get 

(4.3) K Purh (x,y) = \cf)' H (x)\Kp 2ilh ((t>(x),(f)' H (x)y). 
Next, for j = 1,2 we define 

(4.4) Pj,m(^0 = [Kp j ,rh]^(x,0, (x,O^U J xR d+1 \0. 

By Remark 13. 171 for any a G Uj the symbol Pj(a, .) yields in Heisenberg coordinates centered at a 
the principal symbol of Pj at x = 0. Moreover, since <j)' H {a) is a linear map, from (|4.3|) we get 

(4-5) Pl,m(x,0 =P2,m(^)M' H {x)r lt i)- 

This shows that p m := K*pi, m is an element of S m (g* (ViUVi)) which is independent of the choice of 
the chart k\. Since S m (Q*M) is a sheaf this gives rise to a uniquely defined symbol p m G S m (Q*M). 

When £ is a general vector bundle, the above construction can be carried out similarly, so that 
we obtain: 

Theorem 4.2. For any P G ^^(M,£) there is a unique symbol a m (P) G S m (g*M,£) such that if 
in a local trivializing Heisenberg chart U C M. d+1 we let Kp : fh{x,y) G KLfh{U x be the leading 

kernel for the kernel Kp(x, y) in the form h'J. °J2\) for P, then we have 

(4.6) a m (P)(x,0 = [K P , 1 n]^(x,0, (x,£)eU xl w \0. 

Equivalently, for any xq G M the symbol a m (P)(xo, .) agrees in trivializing Heisenberg coordinates 
centered at xq with the principal symbol of P at x = 0. 

Definition 4.3. For P G ^(M,£) the symbol a m {P) G S m (Q*M,£) provided by Theorem \JJ>j is 
called the principal symbol of P. 



18 



Remark 4.4. Since we have two notions of principal symbol we shall distinguish between them by 
saying that a m {P) is the global principal symbol of P and that in a local trivializing chart the 
principal symbol p m of P in the sense of (|3.13[) is the local principal symbol of P in this chart. 

In a local Heisenberg chart U C M. d+1 the global symbol a m (P) and the local principal symbol 
p m of P E ^h(U) can be easily related to each other. Indeed, by Proposition 13. 161 we have 

(4-7) Pm (x,0 = [Kp tm (x,^\y))]y^(x,0, 

where Kp^ m denotes the leading kernel for the kernel Kp in the form (|3.32f) for P. By combining 
this with the definition (|4.4I) of a m (P) we thus get 

(4.8) PmM = (fc<r m (P))(x,Z), 

(4.9) (4>> m (P)) = [W m (P)]l^(x,<fcHv))]i^ = m*m(P)]U,fc*, 

where (jf x is the isomorphism map (|3.3U|) . In particular, since the latter is a linear isomorphism of 
fcm(U x R d+1 ) onto itself, we see that the map p — > <p*p is a linear isomorphism of S m (U x M d+1 ) 
onto itself. 

Example 4.5. Let Xq, . . . ,Xd be a local H-hame of TM near a point a E M. In any Heisenberg 
chart associated with this frame the Heisenberg symbol of Xj is In particular, this is true 
in Heisenberg coordinates centered at a. Thus the (global) principal symbol of Xj is equal to i£j 
in the local trivialization of Q*M \ defined by the frame Xq, . . . ,Xd- More generally, for any 
differential P = J2{a)<m a a (x)X a on M we have 

(4.10) a m (P)(x,0= Yl o«C*0*" |a| £ a - 

(p)<m 

Thus, for differential operators the global and local principal symbols agree in suitable coordinates. 
Alternatively, this result follows from the fact that the isomorphism (|3,3U|) induces the identity 
map on distributions K(x,y) supported in U x {y = 0}. 

Proposition 4.6. For every m E C the principal symbol map a m : ^>^(M,£) — ► S m (Q* M, £) gives 
rise to a linear isomorphism ^(M,£)/^f^ 1 {M,£) S m (Q*M,£). 

Proof. By construction the principal symbol of P E ^fjj(M, £) depends only on his principal part 
in local coordinates and vanishes everywhere if, and only if, the order of P is < m — 1. Therefore, 
the kernel of the principal symbol map a m is ^ / ^ _1 (M, £), so a m induces an injective linear map 
^(M,£)/^~ 1 (M,£) -» S m (g*M,£). 

To complete the proof it is enough to show that a m is surjective. To this end consider a symbol 
Pm(x, € S m (Q*M, £) and let {ifi)i & i be a partition of the unity subordinated to an open covering 
(Ui)i£i of M by domains of Heisenberg charts : U{ — > over which there are trivializations 
Tj : £ i r -> !/; x C. For each index i let ^ E C°°(Ui) be such that ipi = 1 near supp^j and set 

(4.11) P#(z,0 = (1 - x(0)(#U^* r **PH,.^oK x '^ E 5 m (Vi) ® EndC, 

where x E C°°(lR ,:i+1 ) is such that x = 1 near the origin and 4>* x denotes the isomorphism (|4,9|) 
with respect to the chart V{. Then we define a a ^//DO of order m by letting 

(4.12) P = J2<Pi[rt<P^(x,-iXMi. 

For for every index i the local principal symbol of ipi[T*K^p m \x,—iX)]tpi in the chart Vi is 
(fi o K7 1 (^i,a; K i* T i*Pm| B * t ; A0 )i so D Y P^l 1 hs global principal is o kT" 1 ^*^^^,^ ^), which pulls 
back to (^jp m on f/j. It follows that the global principal symbol of P is cr m (P) = ^ifiPm = Pm- 
This proves the surjectivity of the map a m , so the proof is now complete. □ 
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Next, granted the above definition of the principal symbol, we can define the model operator at 
a point as follows. 

Definition 4.7. Let P G ^^(M, £ ) have (global) principal symbol c m (P). Then the model operator 
of P at a G M is the left-invariant ^ u DO- operator P a : So(G a M, £ a ) — ► So(G a M,£ x ) with symbol 
o- m (P)^ y (a,.), i.e., 

(4.13) P a f(x) = (a m (P)^ y (a,y),f(x.y- 1 )), f G S (G a M,£ a ). 

Consider a local trivializing chart U C M. d+1 near a and let us relate the model operator P a on 
G a M to the operator p( a ) = p a m (-iX^) on G^ defined using the local principal symbol p m (x, £) 
of P in this chart. Using 1(511(1 and ((Oil for / G 5 (M a!+1 ) we get 

(4.14) pW/(y) = ((^) v (z),/(y.z- 1 )) = {(^(P^Car.^Hy)),/^" 1 ))- 
Since |^| = 1 and <f> a is a Lie group isomorphism from G^ onto G a M we obtain 

(4.15) P«/(j,) = ((a m (P)^ y (x,y),fo C p- 1 (y.Mxy 1 )) = (KP a )f(y)- 
In particular, we have 

(4.16) P a = (MM-iX^). 

4.2. Composition of principal symbols and model operators. Let us now look at the com- 
position of principal symbols. To this end for a G M we let * a : S nil (M. d+1 ) x 5 m2 (M rf+1 ) — > 
<S' mi + m2 (M d+1 ) be the convolution product for symbols defined by the product law of G a M under 
the identification G a M ~ R d+1 provided by a H-frame X ,...,X d of TM near a, that is, 

(4.17) (p mi * a Pmj )(-iX a ) = Pmi (-iX a ) o Pm2 (-iX a ), p mj G S mj (R d+1 ). 

Let U C be a local trivializing Heisenberg chart chart near a and for j = 1,2 let P, G 

(^0 nave (global) principal symbol a m . (Pj). Recall that under the trivialization of GU provided 
by the P-frame X ,...,X d we have Pf = a(Pj)(x, -iX a ). Thus, 

(4.18) [a mj (P j )(x,,)* a a mj (P,-)(x, .)\{-iX a ) = PfP 2 °. 

On the other hand, using (|4.8|) and (|4.16|) we see that 4> a [p mi * a Pm 2 ]{—^ a ) ls equal to 

(4.19) <p:ip mi (-ix a )o Pm2 (-ix a )] = ( f>:[ Pmi (-ix a )]o ( f>:\p rn2 (-ix a )] 

= (4>* aPmi )(-iX^) o (&p TO )H* (a) ) = M Pmi ) *w (famM-ixV). 

Hence we have 

(4.20) p mi * a Pm2 = (&)*[(&Pmi) * (a) Vp mj G S mj (R d+1 ), 

where (4> a )* denotes the inverse of 0*. Since 0*, its inverse and *( a ) depend smoothly on a, we 
deduce that that so does * a . Therefore, we obtain: 

Proposition 4.8. The group laws on the fibers of GM give rise to a convolution product, 

(4.21) * : S rni ( Q *M,£) x S m2 ( Q *M,£) — » S mi+m2 ( S *M, £), 

(4.22) p mi *p m2 (x,0 = \p mi (x,.) * x p m2 (x, .)](£), Pmj G S mj {$*M,£), 
where * x denote the convolution product for symbols on G X M. 

Notice that (|4.20jl shows that, under the relation (J4.8|) between local and global principal sym- 
bols, the convolution product ((4.17|l for global principal symbols corresponds to the convolution 
product 1(3. 19(1 for local principal symbols. Since by Proposition 13.91 the latter yields the local 
principal symbol of the product of two ^/fDO's in a local chart, we deduce that the convolution 
product ((4.17(1 yields the global principal symbol of the product two f^DO's. 
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Moreover, by Q4.18JI the global convolution product (|4.17|) corresponds to the product of model 
operators, so the model operator of a product of two $^DO's is equal to the product of the model 
operators. We have thus proved: 

Proposition 4.9. For j = 1,2 let Pj € (M, £ ) and suppose that Pi or P2 is properly supported. 

1) We have a mi+m2 (PiP 2 ) = <J mi (P) * cr m2 (P). 

2) At every a € M the model operator of P1P2 is (P\P2) a = PfPf • 

4.3. Principal symbol of transposes and adjoints. In this subsection we shall determine the 
principal symbols and the model operators of transposes and adjoints of $^DO's. 

Recall that if P € *g(M, £) then by Proposition ET23l its transpose P* : C C °°(M, £*) -» C°°(M, £) 
is a VE^DO of order m and its adjoint P* : C£°(M, 5) — ► C°°(M, 5) is a ^^DO of order m (assuming 
M endowed with a positive density and £ with a Hermitian metric in order to define the adjoint). 

Proposition 4.10. Let P € ^^(M, £) have principal symbol a m (P). Then: 

1) The principal symbol of P* is a m (P t )(x,^) = o~ m (x, — £)* (^/iis is an element of S m (g*M,£*)); 

2) If P a is the model operator of P at a then the model operator of P at a is the transpose 
operator (P a Y :S (G X M,£*)^S (G X M,£*). 

Proof. Let us first assume that £ is the trivial line bundle and that P is a scalar operator. In a local 
Heisenberg chart U C R rf+1 we can write the distribution kernels of P and P* in the form (|3.32|) 
with Kp and Kpt in JC m (U x M rf+1 ). Let Kp^ and Kp t . denote the principal parts of Kp and 
Kpt respectively. Then the principal symbols of P and P* are a m (P)(x,^) = (Kp^y^Jx,^) and 
o~m(P t )(x, £) = (Kpt^y^Jx,^) respectively. Since (|3.38j) implies that K P t ^(x,y) = Kp ti %(x,—y) 
and the Fourier transform commutes with the multiplication by —1 we get 

(4.23) a m (P t )(x,0 = o- m (P)(x,-0- 

Next, for a € U let p G S m (G a ) and let P be the left-invariant ^//DO with symbol p. Then the 
transpose P* is such that, for / and g in So(G a U), we have 

(4.24) (P 4 /,5} = (/,Pv> = (l,f(x)(Pg)(x)) = {I, f{x){p{y),g{x.y- 1 ))) 

= (l®p{x,y),f(x)g(x.y- 1 )}. 
Therefore, using the change of variable (x, y) — > (x.y -1 , y _1 ) and the fact y" 1 = —y we get 

(4.25) (P l f,g) = (l®p(x,-y)J(x)g{x.y- 1 )) = (lj(x)(p(-y),g(x.y- 1 ))). 
Since p(—y) = p*(y) with = p{— £), we obtain 

(4.26) (P*/,9) = (lJOz)^),^- 1 ))) = <(p* */)(*),<?(*)}. 

Thus P* is the left-convolution operator with symbol p*(£) = p(— £). 

Now, since the model operator (P*) a is the left-invariant ^#DO with symbol <7 m (P*)(a, £) = 
<7 m (P)(a, — £), it follows that (P*) a agrees with the transpose of P a . 

In the general case, when £ is not the trivial bundle, we can similarly show that P t is a ^//DO of 
order m with principal symbol cr m (P*)(x, £) = o~ m (P)(x, — £)* and such that at every point a € M 
its model operator at a is the transpose (P a )* of P a . □ 

Assume now that M is endowed with a positive density and £ with a Hermitian metric respec- 
tively and let L 2 (M,£) be the associated L 2 -Hilbert space. 

Proposition 4.11. Let P € VP^iVf, £) have principal symbol o~ m (P). Then: 

1) The principal symbol of P* is am(P*)(x, £) = <7 m (P)(x,£)*. 

2) If P x denotes the model operator of P at x € M then the model operator of P* at x is the 
adjoint (p x )* of P x . 
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Proof. Let us first assume that £ is the trivial line bundle, so that P is a scalar operator. Moreover, 
since the above statements are local ones, it is enough to prove them in a local Heisenberg chart 
U C M. d+l and we may assume that P is a ^/^DO on U. 

Let P : C c °° (U) -> C°° (£/) be the conjugate operator of P, so that Pu = P(f) for any / G C c °° (17) . 
By Proposition 13. 161 the distribution kernel of P of the form (|3,32|) with Kp{x, y) in Krh{U x R d+1 ), 
so the kernel of P takes the form 

(4.27) k T (x,y) = k P {x,y) = \e' x \K P (x,y) mod C°° (U x U) . 

Since the conjugation of distribution K(x, y) — ► K(x, y) induces an anti-linear isomorphism from 
/C™(C7 x R d+1 ) onto K*(U x M d+1 ), it follows from Proposition l3~TTIl that P is a f H DO of order 
m and its kernel can be put into the form l|3.32|) with Kp-(x,y) = Kp(x,y). In particular, if we 
let Kp^rh € )Crh{U x M rf+1 ) denote the leading kernel of Kp then the leading kernel of K-p is Kp^. 
Thus P has principal symbol, 

(4.28) cTrn(P)(x,0 = \K^^ y (x,£) = l(K P ^ y (x, -0 = a m (x, =|). 

Moreover, since crfh(P)^ y (x , y) = cr m (P)^ (x, y) the model operator at a G {7 of P is such 
that, for any / G So(G a U), we have 

(4.29) (P) a /(x) = (<7 m (P)^(x,y), fix.y- 1 )) = (a m (P)^ y (x , y) ,J{x~y^) = P*f(x), 
so (P) a agrees with P a . 

Combining this with Proposition 13.211 and Proposition 14. K fl we thus see that P is a ^/^DO of 
order m such that: 

- If we put the kernel of P* into the form (|3.32|) with respect to K-pt(x, y) G K,^{U x M d+1 ), then 
the leading kernel of K-pt is K^t . = Kp t ^,(x, —y); 

- The global principal symbol of P* is cr^(P*) = a m (P t )(x,^) = <r^(P)(a;,^); 

- The model operator at a G J7 of P* is (P*) a =~P^ = (P a )* . 

Now, let dp{x) = p{x)dx be the smooth positive density on U coming from that of M. The 
formal adjoint P* : C£°(U) — > C°°(U) of P with respect to dp is such that 

(4.30) fpf(x)g(x)p(x)dx=fj{x)P*g(x)p(x)dx, f,geC™(U). 
Jf Ju 

Thus P* = p _1 P*p, which shows that P* is a ^//DO of order m. Moreover, as in the proof of 
Proposition 13.211 in Section 03 we can prove that the kernel of P* can be put into the form (|3.32|) 
with K P *(x,y) G 1C m (U x R d+1 ) such that 

(4.31) K P *(x,y) = p(xr 1 K T t(x,y)p(e~ 1 (y)) ~Y,^P( x )~%(p( £ *Hv))\ y=0 Kp>( x >v)- 

a 

In particular, the kernels Kp*(x,y) and Kpt(x,y) agree modulo JC m+1 {U xM rf+1 ), hence have same 

leading kernel. It then follows that P* and P* have same principal symbol and same model operator 
at a point a G U, that is, we have a m (P*)(a, £) = cr m (P)(x,£) and (P*) a = (P a )*. 

Finally, assume that £ is a general bundle, so that the restriction of P to U is given by a matrix 
P = (P {j ) of tf#DO's of order r. Let /i(x) G C°°(U, GL r (C)), h(x)* = h(x), be the Hermitian 
metric on U xC coming from that of £ . Then the adjoint of P with respect to this Hermitian 
metric is P* = p~ 1 h~~ 1 P hp. Therefore, in a the same way as in the scalar case we can prove that 
P* has principal symbol h(x) a m (P)(x, £) h(x) = a m (P)(x,£)* and its model operator at any 
point a G U is /i(a)~ 1 P« < /i(a) = (P a )*. □ 
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5. Hypoellipticity, parametpjces and the Rockland condition 

In this section we define a Rockland condition for %DO's and relate it to the invertibility of 
the principal symbol to get hypoellipticity criterions. 

First, by BG, Sect. 18] in a local Heisenberg chart the invertibility of the local principal symbol 
of a ^f/DO is equivalent to the existence of a ^#DO-parametrix. Using the global principal symbol 
we can give a global reformulation of this result as follows. 

Proposition 5.1. Let P : Cf{M, £) -> C°°(M, £) be a ^ H DO of order m such that k := Km > 0. 
The following are equivalent: 

1) The principal symbol a m {P) of P is invertible with respect to the convolution product for 
homogeneous symbols; 

2) P admits a parametrix Q in ^>~ m (M,£), so that PQ = QP = 1 mod 9~°°(M,S). 

Proof. First, it immediately follows from Proposition 14.91 that 2) implies 1). Conversely, in a local 
trivializing Heisenberg chart 1)4.20(1 shows that the invertibility of the global principal o~ m (P) is 
equivalent to that of the local principal symbol. Once the latter is granted Lemma 13.71 and Propo- 
sition 13.91 allows us to carry out in a local trivializing Heisenberg chart the standard parametrix 
construction in a trivializing Heisenberg chart to get a parametrix for P as a ^^DO of order 
— m (see |BG| p. 142]). A classical partition of the unity argument then allows us to produce a 
parametrix for P in ^ m (M, £). □ 

When a ^/fDO has an invertible principal symbol using the Sobolev regularity properties of its 
parametrices allows us to get: 

Proposition 5.2 (jEH p. 142]). Let P : C™(M,£) -» C°°(M,£) be a ^ H DO of order m whose 
principal symbol is invertible. If k := Km > then P is hypoelliptic with loss of ^-derivatives, i.e., 
for any a € M , any u € £'(M, £) and any s € R, we have 

(5.1) Pu is L\ near a ==> u is L 2 s+k near a. 

In particular, if M is compact then, for any reals s and s' , we have the estimate, 

(5-2) \\f\\ L 2 < C ss ,(\\Pf\\Ll + ll/lk)' u e C°°(M,£). 

s+k s s l 

Remark 5.3. We can give sharper hypoellipticity regularity results for f^DO's in terms of suitably 
weighted Sobolev spaces (see |FSj . |Po3j ) . When P is a differential operator and the Levi form is 
non-vanishing these results correspond to the maximal hypoellipticity of P as in HN3 . 

Now, let P : C°°(M, £) -> C°°(M, £) be a *DO of order m and assume that M is endowed with 
a positive density and £ with a Hermitian metric. Let P a be the model operator of P at a point 
a G M and let n : G — > TC n be a (nontrivial) unitary representation of G = G a M. We define the 
symbol n pa as follows (see also |Rolj . |Glj . |CGGPj ). 

Let T-L%{£ a ) be the subspace of 7Y„-(£ a ) := TC^ <S> £ a spanned by the vectors of the form 

(5.3) TT f i = [ (ir x ®le a )(S®f(x))dx, 

Jg 

as £ ranges over TL^ and / over So(G,£ a ) = <Sq(G) ® £ a - Then we let ixpa denote the (unbounded) 
operator of H n (£ a ) with domain Ti^{£ a ) such that 

(5.4) 7rpa ( 7r/ £) =7rpo/ £ V/eS (G,£ a ) V(eH r 

One can check that -Kpa* is the adjoint of irpa on Ti.®, hence is densely defined. Thus 7rpa is 
closeable and we can let ~T~pa~ denotes its closure. 

In the sequel we let C%°(£ a ) = C£° (g> £ a , where C denotes the space of smooth vectors 
of 7r (i.e. the subspace of vectors £ € H n so that x — > 7r(x)£ is smooth from G to H n ). 
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Proposition 5.4 ( CGGP ). 1) The domain ofirpa always contains C£°(£ a ). 

2) If$tm < then the operator Wp~a~ is bounded. 

3) We have (ir P a)* = (WpZ)*. 

4) If Pi and P2 are ^DO's on M then vr(p 1 p 2 )a = WpaWp*. 

Remark 5.5. If £ a = C and P a is a differentiable operator then, as it is left-invariant, P a belongs 
to the enveloping algebra U(g) of the Lie algebra q = Q a M of G. In this case Wpa~ coincides on C£° 
with the operator dir(P a ), where dir is the representation of U(q) induced by it. 

Definition 5.6. We say that P satisfies the Rockland condition at a if for any nontrivial unitary 
irreducible representation ir of G a M the operator it pa is injective on C%°(£ a ). 

Since G = G a M ~ H 2n+1 x M. d ~ 2n with In = rk£ a , there are left-invariant vector fields 
Xq, . . . , X<i on G such that Xq, . . . , Xm are the left-invariant vector fields on H 2ri+1 given by l)2.2[) 
and Xfc = g^- for k = 2n + 1, . . . , d. Then, up to unitary equivalence, the nontrivial irreducible 
representations of G are of two types: 

(i) Infinite dimensional representations tt X '^ : G — > L 2 (R n ) parametrized by A E R \ and 
£ = (6n+l, • • • , 6n) such that 

(5.5) dir x 'Z(X ) = i\\X\, dir x 'Z(X k ) = i\£ k , k = In + 1, . . . , d, 

(5.6) dn x *(X j ) = \\\£-, d^{X n+] )=i\i v j = l,...,n. 

Moreover, in this case we have C 00 (7r =l: ''>) = 5(M ra ). 

(ii) One dimensional representations 7r^ : G — > C indexed by £ = (£1, . . . , £<j) £ W 1 \ such that 

(5.7) d^(X ) = 0, d-iX/) i^. j = l,...,d. 

In particular, if P = p m (—iX) with p E S m (G) then the homogeneity of the symbol p implies 

that we have ir p ^ = \X\ m irp'^ where 7Tp'^ = vrp 1 ''* accordingly with the sign of A. 

On the other hand, for the representations in (ii) we have ir p = tt p = p m (0, £1, ■ ■ ■ ,£d)- Therefore, 
we get: 

Proposition 5.7. The Rockland condition for P = p m (—iX a ), p m E S m {G a M), holds, and only 
if, the following two conditions are satisfied: 

(i) The operators ftp'^, £ E M. d ~ 2n , are injective on <S(R n ); 

(ii) The restriction of the symbol p m to {0} x (R n \ 0) ~ H* \ is pointwise invertible. 

Remark 5.8. In the case of G a M = M 2n+1 the conditions (i) and (ii) have those considered by 
Taylor |Tay| . 

Next, if P E tyfl^M, £) has an invertible principal symbol, hence admits a parametrix Q E 
^Jj m (M,£), then for any a E M we have Q a P a and (Q a ) t (P a ) t are equal to 1 on S {G a M,£ a ) and 
So(G a M,£*) respectively. It then follows from Proposition 15.41 that for any nontrivial irreducible 
unitary representation it of G a the operators WpT and WFpay are injective on C°°(7r). Thus P and 
P t satisfy the Rockland condition at every point of M. 

Conversely, if at some point a E M the model operator (P a ) t satisfies the Rockland condition 
then (P a Y is hypoelliptic (see [RoT] . [Re^j . see also fTTNT] . [HN2] . jCXidPj V The latter fact 
then implies that P a admits a fundamental solution k a E S'(G a M,£ a ) so that P a k a = 5 a (see |Foj . 
|(irej . |(Xir(TPj ). In particular, the inverse Fourier transform of k a yields an inverse for the symbol 
of P a . 

This shows that if P and P t satisfies the Rockland condition at every point then for any a E M 
there exists q°L m E S*_ m (g*M, £ a ) so that q a * a a m (P)(a,.) = a m (P)(a, .) * a q a = 1. However, 
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it is an open problem to determine whether q a depends smoothly a and so define an element of 
S m (g*M,£). 

The above issue is at least true in the case of sublaplacians (see |BG| and next section). As we 
shall now see this result can be extended to arbitrary ^/^DO's when the Levi form of (M, H) has 
constant rank. More precisely, we have: 

Proposition 5.9. Suppose that the Levi form of (M,H) has constant rank and let P € \Pjy(Af, £). 
Then the following are equivalent: 

(i) P and P* satisfy the Rockland condition at every point of M; 

(ii) P and P* satisfy the Rockland condition at every point of M; 

(Hi) The principal symbol of P is invertible. 

In particular, if (i) holds then P admits a parametrix in ^^ m (M, £) and is hypoelliptic with loss 
of ^sfcm derivatives. 

Proof. We saw that (i) implies (iii) already. The same argument shows that (ii) implies (i). Thus 
we only need to prove the converse statements. 

Assume that P and P t satisfies the Rockland condition at every point. For sake of simplicity let 
us further assume that £ is the trivial line bundle, so that P and P* are scalar operators. We need 
to show that the principal symbol of P is invertible. As this is a local issue it is enough to prove 
it in a local Heisenberg chart U C M a!+1 , so we may assume that P and P t are $^DO's on U. 

Moreover, since the Levi form has constant rank it follows from |Po2[ Prop. 2.8] that GM is a 
fiber bundle of Lie group with fiber G = H 2n+1 x IR d-2n , where 2n is the rank of the Levi form. 
Therefore, by considering a trivialization of this fiber bundle by means of a suitable local P-frame 
(see |Po2| p. 5]) we may further assume that GU is the trivial bundle U x G. In particular, the 
families of model operators (P x ) x ^u and ((P t ) x ) X £u can be seen as smooth families of left-invariant 
$ ff DO's on G as in j( XlCiPj . 

Now, since P x satisfies the Rockland condition for every x 6 U it follows from |GGGP| Thm. 5(d)] 
near every xq € U there exists an open neighborhood V C U of xo and a smooth family {K x ) x ^y C 
IC m -d-2(G) such that if for x € V we let Q x be the left-convolution operator with K x acting on 
Sq{G) then Q x is a left-inverse for P x . 

As (P*) x = (P x ) t satisfies the Rockland condition for every x € V the same arguments show 
that (P x )* is left-invertible on Sq(G) for any x in an open neighborhood W of xq contained in V. 
Thus P x is invertible with two-side inverse Q x . 

Since Q x is the left-invariant 'I'^DO with symbol q^ m = (K X ) A in S- m (G) we see that we have 

(5.8) q x _ m *a m (P)(x,.)=a m (P)(x,.)*q x _ m = l Vx £ W. 

In fact, as K x depends smoothly on x, that is, yields an element of IC- m (W x G), we get a symbol 
in S- m (W x g*) by letting g_ m (x,£) = g^ m (£). Then (|5.8j) shows that </_ m is an inverse for a m (P) 
on W x (q* \0). This shows that o~ m (P) is invertible near every point of U, so a m (P) is an invertible 
symbol. 

Next, since the aforementioned result of |GGGP| remains valid mutatis standis for systems, by 
working in a local trivializing Heisenberg chart we can similarly show that, in the case £ is a general 
bundle, if P and P satisfy the Rockland condition at every point then the the principal symbol of 
P is invertible. Thus the assertions (i) and (ii) are equivalent. 

Finally, the above arguments remain valid when we replace the transpose P by the adjoint of 
P, so the statements (ii) and (iii) are equivalent. □ 

In particular, when the Levi form of (M, H) has constant rank and P is selfadjoint the Rockland 
condition for P is equivalent to the invertibility of the principal symbol of P, hence is equivalent 
to the existence of a parametrix in ^fJ j ^ n (M, £). 
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6. Hypoellipticity criteria for sublaplacians 

The main focus of this section is on sublaplacians, which furnish several important examples of 
operators on Heisenberg manifolds. The scalar case was dealt with in |BG| . but the results were 
not extended to sublaplacians acting on sections of vector bundles. These extensions are necessary 
in order to deal with sublaplacians acting on forms such as the Kohn Laplacian or the horizontal 
sublaplacian (see next section). 

In this section, after having explained the scalar case from the point of view this paper, we extend 
the results to the non-scalar case. In particular, this will allow us to complete the treatment of the 
Kohn Laplacian in |BG| (see Remark 17 . 31 ahead ) . 

Definition 6.1. A differential operator A : C°°(M,£) — > C°°(M, £) is a sublaplacian when, near 
any point a E M, we can put A in the form, 

(6.1) A = -(Xl + ...+X 2 d )- iv(x)X + 0^(1), 

where Xq,X\, . . . ,X^ is a local H -frame ofTM, the coefficient [J,(x) is a local section of End £ and 
the notation 0#(1) means a differential operator of Heisenberg order < 1. 

Let us look at the Rockland condition for a scalar sublaplacian A : C°°(M) — > C°°(M). Let 
a € M and let Xq, X\, . . . , X^ be a local H- frame of TM so that near a we can write 

d 

(6.2) A = -J2 x ]-w(x) x o + Oh{1), 

3=1 

where n{x) is a smooth function near a. Using (|4.1U|) we see that the principal symbol of A is 

(6.3) a 2 (A)(x,£) = |£f + /u(a)£o, £' = . . . , 

In particular we have o~%(A)(x, 0, £') = £'| 2 > for £' ^ 0, which shows that the condition (i) of 
Proposition 15.71 is always satisfied. 

Let L(x) = (Ljk(x)) be the matrix of the Levi form C with respect to the ff-frame Xq, . . . , Xj, 
so that for j, k = 1, . . . , d we have 

(6.4) C(Xj,X k ) = [Xj,X k ] = L jk X mod H. 

Equivalently, if we let g{x) be the metric on H making orthonormal the frame X±, . . . , X4, then for 
any sections X and Y of H we have 

(6.5) C(X, Y) = g{x) (L(x)X, Y)X mod H. 

The matrix L(x) is antisymmetric, so up to an orthogonal change of frame of H, which does not 
affect the form (|6.2|) . we may assume that L(a) is in the normal form, 



(6.6) L(a)=\ -D , D = diag(Ai, . . . , A„), Xj > 0, 




so that ±zAi, . . . , ±\2n, 0, . . . , are the eigenvalues of L(a) counted with multiplicity, the multi- 
plicity of being d — 2n. Then the model vector fields Xq , . . . , X% are: 

(6.7) X $ = lT-> X k = ir-> k = 2n+l,..,d, 

OXq OXk 

(6 - 8) X " = ^-^ XjXn+j ^ Xa ^ = ^ + \ X ^^ i = l,-.n. 

In terms of these vector fields the model operator of A at a is 

(6.9) A a = -[(A7) 2 + . . . + (X?) 2 ] - Ma)X a . 
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Next, under the isomorphism (f> : M. 2n+1 xM d 2n — > G a M given by 

i i i i 

(6.10) <f>(x Q , ...,X d ) = (xq, XI Xi, . . . , X%X n , X?X n+ i, . . . X%X 2n ,X2n+l, Xd), 

the representations it = tt £ 6 {0} 2n x M. d ~ 2n , become the representations of G a M such that 

(6.11) d7r ±,s (Xo) = ±i, thr^^Xk) = ±i&, k = In + 1, . . . , d, 

(6.12) dit ± ^{X j ) = X]^-, dTr ± >t(X n+j ) = ±iX]£ j , j = l,...,n, 

n 

(6.13) = d^(A a ) = H-dl + CD ± (&+i + • • • + 3 + A*(a)). 

3=1 

The spectrum of the harmonic oscillator Y^=i ^f- + £f) is Sj=i^i(l + 2N) and all its 

eigenvectors belong to <S(IR n ). Thus, the operator it^a is injective on 5(IR n ) if, and only if, £fn+i + 

• • • + id + A»(«) is not ± £"=i A i(! + 2N )- This occurs for an y £ 6 {°} 2n x Rd ~ 2n if > and onl y if , the 
following condition holds 



(6.14) n(a) is not in the singular set A a , 

(6.15) A a = (— oo, — - Trace \L(a)\] U [- Trace \L(a)\, oo) if 2ra < d, 

(6.16) A a = {±(-Trace|L(a)| + 2 ^ ajlAjl);^ € N d } if 2n = d. 

l<j<n 



In particular, the condition (ii) of Proposition 15 . 71 is equivalent to (|6.14|) . Since the condition (i) is 
always satisfied, it follows that the Rockland condition for A is equivalent to Q6.14JI . 

Notice also that, independently of the equivalence with the Rockland condition, the condi- 
tion ()6.14|) does not depend on the choice of the if-frame, because as A a depends only on the 
eigenvalues of L(a) which scale in the same way as n(a) under a change of //-frame preserving the 
form (|E2J). 

On the other hand, since the transpose (A a ) 4 = (A*) a is given by the formula ()6.9|) with //(a) 
replaced by — /i(a), which has no effect on (|6.14j) . we see that the Rockland condition for (A*) a too 
is equivalent to Q6.14JI . Therefore, we have obtained: 

Proposition 6.2. The Rockland conditions for A* and A at a are both equivalent to {6.1$ - 

In particular, we see that if the principal symbol of A is invertible then the condition H6.14|) 
holds at every point. As shown by Beals-Greiner the converse is true as well. The key result is the 
following. 

Proposition 6.3 f |BGl Sect. 5]). Let U C M. d+1 be a Heisenberg chart near a and set 

(6.17) n = {(jj,, x) £ C x U; n$ A x }. 

Then Q is an open subset of C x U and there exists qu(x,£) € C°°(Q x M rf+1 \0) such that: 

(i) qu(%,£) is analytic with respect to (j,; 

(ii) We have q^(x,X.^) = X~ 2 q^(x,{;) for any X > 0. 

(in) For any (fJ>,x) € 0, the symbol q^(x,.) inverts \£'\ 2 -M/^£q on G X U , i.e., we have 

(6.18) q^x, .) * x (|ef + i^o) = (lef + il4o) * x q»(x, •) = 1- 
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More precisely, q^x,^) is obtained from the analytic continuation of the function, 

f'°° 1 
q^(x,i)= e-^G(x^,t)dt, \^\<-Tr\L(x)\, 
Jo 1 

G(x, & t) = det "I [coBh(f [ft 1 \L(x)\)} 01 

This implies that if the condition Q6.14JI is satisfied at every point x G U then we get an inverse 
g_ 2 G S_2(f7 x for ff 2 (A)(a?,0 = W\ 2 + on U x by letting 

(6.19) g- 2 (x,0 = ? M («)(x,0, (*,£) &Ux (R d+1 \0). 

It thus follows that if ()6.14j) holds at every point of M then the principal symbol of A is invertible 
near any point of M, hence admits an inverse in S , _2(fl*M). Therefore, we get: 

Proposition 6.4. A scalar sublaplacian A : C°°(M) — > C°°(M) has an invertible principal symbol 
if, and only if, it satisfies the condition \b\lJ$ at every point. 

Let us now extend the above results to the case of a sublaplacian A : C°°(M, 6) — > C°°(M, £) 
acting on the sections of the vector bundle E. 

Let a G M and let Xq, . . . , Xj be a local if-frame near a with respect to which we have 

d 

(6.20) A = -^X] -ifi(x)X + O H (l), 

where is a smooth section of End£. 

In a suitable basis of £ a the matrix of /x(a) is in triangular form, 

f fj,i(a) * * 

(6.21) fj,(a)= o * 

\ n r {a) 

where [i\ (a),..., fir (a) denote the eigenvalues of fi{a) counted with multiplicity. Therefore, the 
model operator of A at a is of the form, 

/ Af * * \ 

(6.22) A a = o •-. * , ^ = -[(X^ + ... + (Xf) 2 )-i^{a)XS. 

\ A? J 

It follows that A a satisfies the Rockland condition if, and only if, so does each sublaplacian A", 
j = 1, ... ,r. Using Proposition 16.41 we then deduce that the Rockland condition A a is equivalent 
to the condition, 

(6.23) Sp/i(a) n A a = 0. 

Notice that the same is true for the transpose (A a )*. Moreover, the condition (|6.23j) is inde- 
pendent of the choice of the basis of £ a or of the if-frame since the condition involves //(a) only 
though its eigenvalues of fi(a) and the latter scale in the same way as that of L{a) under a change 
of H- frame preserving the form (|6.2U|) . 

Next, concerning the invertibility of the principal symbol of A the following extension of Propo- 
sition Urni holds. 

Proposition 6.5. Let U C M. d+1 be a trivializing Heisenberg chart near a and set 

(6.24) tt = {(fj,, x) G Ar P (C) x U; fi A^}. 

Then f2 is an open subset of M r (C) x U and there exists q^x, £) G C°°(f2 x M d+1 \0, M r (C)) so that: 
(i) qn(x,£) is analytic with respect to fi; 
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(ii) We have q fl (x,X.$ t ) = A 2 q^,(x,^) for any A > 0. 

(Hi) For any (fJ-,x) G £1 the symbol q^(x,.) inverts |£'| 2 + i/u£o on G X U, that is, we have 

(6.25) q^x, .) * x (|Cf + i^ ) = (|£f + i/^o) •) = 1. 

Proof. It is enough to prove that near point {(jlq,xq) G SI there exists an open neighborhood O' 
contained in and a function q^x,^) G C°°(fi x M rf+1 \0, M r (C)) satisfying the properties (i), (ii) 
and (iii) on ft' x M d+1 \0. 

To this end observe that since Sp/U C D(0, \\fj,\\) for any /i € M r (C), we see that if we let 
K = B(0, 1| + 1) then any /i G M r (C) close enough to fio has its spectrum contained in K. 

Let 5 > be small enough so that 5 < \ dist(Sp hq, A xq ) and define V\ = Sp/io + D(0,5) and 
Vi = A XQ + D(0 } 8), so that Vi and V2 are disjoint open subsets of C containing Sp^o and A Xo 
respectively. 

Notice that for any fj, close enough to we have Sp fj, C V± ■ Otherwise there exists a sequence 
(A*fe)fc>i C M r (C) converging to /Xq and a sequence of eigenvalues (\k)k>i C AT, A& G Sp/z/j, such 
that Afc V\ for any /c > 1. Since the sequence {\k)k>i 1S bounded, we may assume that it converges 
to some A V%. Necessarily A is an eigenvalue of /j,q, which contradicts the fact that A £ V%. Thus 
there exists r/i > so that for any fj, G B(fiQ,r]i) we have Sp// C V\. 

Similarly there exists r\2 > so that for any x G B(xq, 7/2) we have Sp |L(x)| C Sp \L(xo)\+D(0, 5), 
which implies A x C A Xo + D(0, 5) = V%. Therefore the open set Q' = B(fj,Q,r)i) x B(xq,t]2) is such 
that for any (/i, x) G O' we have Sp/x D A x C Fi D V2 =, that is, O' is an open neighborhood of 
(//q,3;q) contained in 0. 

Next, let T be a smooth curve of index 1 such that the bounded connected component of 
C \ r contains V\ and its unbounded component contains V2. Then we define an element of 
Rol(B(n ,r ]1 ))®C QO {B(xo,V2) x R d+1 \0) by letting 

(6.26) ^6 = 2^/97(^6(7-^7, (/i,^)^'xl W \0. 

This function is homogeneous of degree —2 with respect to £ and for any x) G O' we have 

(6.27) g „(x, .) ** (|£'| 2 + i M Co) = ^~ J q-y(x, •) (|£'| 2 + ^o)(7 - m)" 1 ^, 

2^: y [(7 - - »*y(z, •) * 6)^7 = 1. 

Similarly we have (|£'| 2 + i/-i£,o) * x q^,(x, .) = 1. Thus q^x,^) satisfies the properties (i), (ii) and (iii) 
on $7' x IR d+1 \0. The proof is thus complete. □ 

In the same way as Proposition 16.31 in the scalar case, Proposition 16.51 implies that when the 
condition (|6.23|) holds everywhere the principal symbol of A admits an inverse in 5_2(fl*M, £). We 
have thus proved: 

Proposition 6.6. 1) At every point a G M the Rockland conditions for A and A* are equivalent 
to IQ3I). 

2) The principal symbol of A is invertible if, and only if, the condition \b\23\) holds everywhere. 
Moreover, when the latter occurs A admits a parametrix in ^t/(M, £) and is hypoelliptic with loss 
of 1 derivative. 

7. Examples of hypoelliptic operators on Heisenberg manifolds 

In this section we explain how the previous results of this paper can used to deal with the 
hypoellipticity for the main geometric operators on Heisenberg manifolds: Hormander's sum of 
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squares, Kohn Laplacian, horizontal sublaplacian and contact Laplacian. In particular, the treat- 
ment in |BG) of the Kohn Laplacian and we establish a criterion for the invertibility of the horizontal 
sublaplacian, which has not been done before. 

7.1. Hormander 's sum of squares. Let X\, . . . ,X m be (real) vector fields on a manifold M d+1 
and consider the sum of squares, 

(7.1) A = -(X 2 + ...+X 2 J. 

By a celebrated theorem of Hormander H62j the operator A is hypoelliptic provided that the fol- 
lowing bracket condition is satisfied: the vector fields Xo, X±, . . . , X m together with their successive 
Lie brackets [Xj 1 , [Xj 2 , . . . ,Xj x \ • • .]] span the tangent bundle TM at every point. 

When X\ , . . . , X m span a hyperplane bundle H the operator A is a sublaplacian with real co- 
efficients and the bracket condition reduces to H + [H, H] = TM, which is equivalent to the 
non- vanishing of the Levi form of (M, H) . 

More generally, given a vector bundle £ , the theorem of Hormander holds for sublaplacians 
A : C°° (M, £ ) -> C°° (M, £) of the form 

(7-2) A = -{V 2 Xi + ... + V 2 x J + H (l), 

where V is a connection on £ . In particular, if M is endowed with a positive density and £ with a 
Hermitian metric, this includes the selfadjoint sum of squares, 

(7-3) A = V3, 1 V Xl + ... + V^V Xm . 

In fact, if A is a sublaplacian of the form (|7.2|) then in 1)6.1(1 the matrix fi(x) vanishes, so 
that ()6.23|) holds if, and only if, the Levi form does not vanish at x. Therefore, we obtain: 

Proposition 7.1. Let A : C°°{M,£) — » C°°(M, £) be a (generalized) sum of squares of the 
form \7.2\j . Then: 

1) At a point x E M the operators A and A* satisfies the Rockland condition if, and only if, the 
Levi form C does not vanish at x. 

2) The principal symbol of A is invertible if, and only if, the Levi form is non-vanishing. In 
particular, when the latter occurs A admits a parametrix in ^~^(M,£) and is hypoelliptic with loss 
of one derivative. 

In particular, since the nonvanishing of the Levi form is equivalent to the bracket condition H + 
[H, H] = TM, we see that, the special case of Heisenberg manifolds, we recover the hypoellipticity 
result of Hq2] for sums of squares. 

7.2. The Kohn Laplacian. In KK Kohn-Rossi showed that the Dolbeault complex on a bounded 
complex domain induces on its boundary a horizontal complex of differential forms. This was later 
extended by Kohn Kohl] to the general setting of a CR manifold M 2n+1 as follows. 

Let M 2n+1 be a CR manifold with CR bundle T lj0 C T C M and set T 0>1 = J\^. Then the 
subbundle H = ^(T^o © ^b,i) C TM admits an integrable complex structure and the splitting 
H <g) C = T^o © To,i gives rise to a decomposition AH* © C = (&o<p,q<nA p ' q , where (p, q) is called a 
bidegree of a form with values in A p ' q . 

Assume that TqM is endowed with a Hermitian metric such that T\ t o and I^i are orthogonal 
subspaces and complex conjugation is an (antilinear) isometry. This Hermitian metric gives rise to 
a Hermitian metric on A*T^M with respect to which the decomposition AH* © C = ®o< p ,q< n A p,q 
becomes orthogonal. Let n Pi9 : A*T^M — > A p,q be the orthogonal projection onto A p,q . Then the 
Kohn-Rossi operator B b : C°°(M,A p ' q ) -> C°°(M,A p ' q+l ) is given by 

(7.4) B b ri = n M+1 (d V ), n G C°°(M,A p ' q ). 

Since the integrability of T± : q implies that B 2 = 0, this yields chain complexes B b : C°°(M, A p '*) — > 
C°°(M,A p '* +1 ). 
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Endowing M with a smooth density p > we let d£ denote the formal adjoint of 8 b . Then the 
Kohn Laplacian is 

(7.5) D b = (B b + Blf = B* b B b + B b B* b . 

The Kohn Laplacian is a sublaplacian (see |FS1 Sect. 13], jBGl Sect. 20]) and it was shown by 
Kohn |Kohlj that under the condition Y(q) this operator is hypoelliptic with loss of one derivative 
when acting on (p, g)-forms. 

The condition Y(q) means that if for x G M we let (r(x) — k{x), k(x), n — r(x)) be the signature 
of Lq at x, so that r(x) is the rank of Lq and n(x) the number of its negative eigenvalues, then the 
condition Y{q) is satisfied at x G M when we have 

(7.6) q g" {k(x), k(x) + 1, . . . , k(x) + n — r(x)} U {r(x) — k(x), r(x) — k(x) + 1, . . . , n — k(x)}. 

For instance, when M is K-strictly pseudoconvex, the Y(g)-condition exactly means that we must 
have q ^ k and q ^ n — k. 

In fact, as shown in |BG1 Sect. 21], at every point a G M the condition Y(q) is equivalent to the 
condition (|6,23|) for the Kohn Laplacian acting on (p, g)-forms. Therefore, using Proposition 16.61 
we immediately get: 

Proposition 7.2. Let D b : C°°(M, A p > 9 ) -> C°°(M,A P ' < ?) be the Kohn Laplacian acting on (p,q)- 
forms. 

1) At a point x G M the Rockland condition for \3 b is equivalent to the condition Y(q). 

2) The principal symbol of □& is invertible if, and only if, the condition Y(q) is satisfied at 
every point. In particular, when the latter occurs □& admits a parametrix in ^/J^(M, A p ' q ) and is 
hypoelliptic with loss of one derivative. 

Remark 7.3. The proof of the second part of the statement in |BG1 Sect. 21] is not quite complete, 
because Beals-Greiner claim that diagonalizing the leading part of the Kohn Laplacian allows us to 
use to apply the results for scalar sublaplacians. While this property is true in case of a Levi Metric 
(see |FSj ). it may fail for a general metric on Tt^M since a smooth eigenframe needs not exists For 
instance, for the Kohn Laplacian the eigenvalues of the matrix p,(x) in (|6.1j) with respect to an 
orthonormal //-frame of TM are given in terms of eigenvalues of the Levi form (see Eq. (21.31) 
in |BG| ). but the latter need not depend smoothly on x (unless the metric on TqM is a Levi metric). 
Therefore, in order to deal with the Kohn Laplacian acting on forms, we really need to use the 
version for sublaplacians acting on section of vector bundles, provided by Proposition 16.61 but not 
deal with in |BG| . 

Remark 7.4. The Y ((^-condition is only a sufficient condition for the hypoellipticity of as the 
latter may be hypoelliptic when the Y(g)-condition fails (e.g. |Koh2j . |Koj . |Nij). 

7.3. The horizontal sublaplacian on a Heisenberg manifold. Let (M d+l , H) be a Heisenberg 
manifold endowed with a Riemannian metric and let A^H* = (Bf =Q A^H* be the (complexified) 
bundle of horizontal forms. Then the horizontal sublaplacian A b : C°°(M, A^/P) — > C°°(M, A^,H*) 
is given by 

(7.7) A b = dld b + d b dl, d b a = ir b (dct), 

where 7Tb denotes the orthogonal projection of A^T*M onto A^H* . 

This operator was first introduced by Tanaka |Taj for strictly pseudoconvex CR manifolds, but 
versions of this operator acting on functions were independently defined by Greenleaf |Gr and 
Lee |Lej . Moreover, it can be shown that d\ = if, and only if, the subbundle H is integrable, so 
in general A b is not the Laplacian of a chain complex. 

As we shall see to determine under which condition the principal symbol of A b is invertible the 
relevant condition to look at is the X(fc)-condition below. 
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Definition 7.5. For x £ M let 2r(x) denote the rank of the Levi form C at x. Then we say that 
C satisfies the condition X(k) at x when we have 

(7.8) k g {r(x),r(x) +l,...,d- r(x)}. 

For instance, the condition X(0) is satisfied if, and only if, the Levi form does not vanish. Also, 
if M 2n+1 is a contact manifold or a nondegenerate CR manifold then the Levi form is everywhere 
nondegenerate, so r(x) = 2n and the X(/c)-condition becomes k ^ n. In any case, we have: 

Proposition 7.6. Let A b : C°°(M,A^H*) — > C°°(M, A^H*) be the horizontal sublaplacian acting 
on horizontal forms of degree k. 

1) At a point x E M the Rockland condition for A b is equivalent to the condition X(k). 

2) The principal symbol of A b is invertible if, and only if, the condition X[k) is satisfied at 
every point. Ln particular, when the latter occurs A b admits a parametrix in ^J^(M,A^H*) and 
is hypoelliptic with loss of one derivative. 

Proof. First, thanks to Proposition 16.61 we only have to check that for k = 0, . . . ,d at any point a 

the condition (|6.23|) for A b i fe s is equivalent to the condition X(k). 

A c H * 

Next, let U C M. d+1 be a Heisenberg chart around a together with an orthonormal iZ-frame 
Xq,Xi, . . . Xd of TU. Let g be the Riemannian metric of M. Then on U we can write the Levi 
form C in the form, 

(7.9) C(X, Y) = [X, Y] = (L(x)X, Y)X mod H, 

for some antisymmetric section L(x) of Ends H. In particular, if for j,k = 1, . . . , d we let L,j. = 
(LXj,Xk) then we have 

(7.10) [X j ,X k ]=L jk X modi?. 

Let 2n be the rank of L(a). Since the condition ()6.23|) for A^ at a is independent of the choice of 
the Heisenberg chart, we may assume that U is chosen in such way that at x = a we have g(a) = 1 
and L(a) is in the normal form, 



(7.11) L(a)=\ -D , L» = diag(A 1 ,...,A n ), Xj > 0, 




so that ±£Ai, . . . , ±i\ n ar e the nonzero eigenvalues of L(a) counted with multiplicity. 

Let or, . . . ,uj n be the coframe of H* dual to X\,... , A^. For a 1-form uj we let s(u) denote 
the exterior product and l(lo) denote the interior product with co, that is, the contraction with the 
vector fields dual to uj. For an ordered subset J = {ji, ■ ■ ■ , jk} C {1, • • • , d}, so that j\ < ■ ■ ■ < jd, 
we let uj j = uji 1 A ... A uj^ h (we make the convention that uj® = 1). Then the forms uj j, s give rise 
to an orthonormal frame of A^H* over U. With respect to this frame we have 

d d 

(7.12) d b = J2 £ ( ujj ) X j and d b = -X/( c ^) X ' + °tf( 1 )- 

j=l 1=1 

Thus, 



(7.13) A b = d* b d b + d b d* h = - Y^H^H^jXi + i^e^XiXj] + H (1) = 

3,1 

1 d 

- M" 3 W) + i^WJWXjXt + XiXj) + (ebJXcJ) - L^e^X^Xi}] + H {1). 



2 

3,1=1 
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Combining this with (|7.10|) and the relations, 

(7.14) e{<J)l(J) + L(J)e((J) = 5 3h j,l = l,...,d, 

we then obtain 



(7.15) A b = -J2Xj-¥{x)Xo + H {l), ^{x) = - i Y J s{^)i{J)L j 

3=1 1 3,1=1 

In particular, thanks to (|7.11j) at x = a we have 

1 n 

(7.16) fa) = - £>(^>(u/^) - s^X^Xj. 



1 3=1 



For j = 1, . . . , n let 9 j = + iuj n+ i) and $ = -±-(<J - ioj n+ i). Then we have: 



(7.17) l(e(<J)i(u n+i ) - E(v n+ ')i(<J)) 
i 



-^-M9 j ) + e{e j )){i{9 j ) - L(6 j )) - (e(e j ) - e(6~ j ))(i(9~ j ) + i(9 j ))] = e{9 j )i{9 j ) - e(9~ j X9 ] ) 



Thus, 



(7.18) M (a) = J>(^>(^') - e(0XP))\j. 

3=1 

For any ordered subset J = {ji, . . . ,j p } of {1, ... , n} we let 

(7.19) 9 J = 9 jl A...A0*, 9 k = 6~ kl A...A9 h ", 

Then the forms 9 J A 9 K A u) L give rise to an orthonormal frame of A^H* as J and if range over 
all the ordered subsets of {1, . . . , n} and L over all the ordered subsets of {2n + 1, . . . , d). For 
j = 1, . . . , n we have 

(7.20) e (6»>(6»')(0 J A 0* A co L ) = / ^ A ^ A ^ if ' G J ' 



(7.21) e(PXP)(e J A0*Au L )=-t O'* *^ iij ^ K ' 



if j ^ J, 

K Au L if j € if, 
if j if. 

Combining this with Q7.18JI then gives 

(7.22) M (a)(0 J A 9 R A lo l ) = ^ R [a)9 J A 9 R A u L , ^ R (a) = £ X j - £ A r 

This shows that /u(a) diagonalizes in the basis of A^H* provided by the forms of 9 J A 9 K Au L with 
eigenvalues given by the numbers fij R (a). In particular, for k = 0, . . . ,d we have 

(7-23) S PM«)| AfeH * = I J| + 1*1 < k}. 

Note that we always have \/j>j,k\ < !Cj=i W1 th equality if, and only if, one the subsets J or K 
is empty and the other is {1, . . . , n}, which occurs for eigenvectors in the subspace spanned by the 
forms 9 1 A . . . 9 n A uj l and 9 l A . . . 9 n A lo l as L ranges over all the subsets of {2n + 1, . . . , d}. 

Since Ai,...,A n are the eigenvalues of |L(a)|, each of them counted twice, if follows that the 
condition (|6.23j) for ^b\ A h H , reduces to ±Xij=i^j ^ SpM a )| AfeH „- This latter condition is satisfied 

if, and only if, the space A^H* does contain any of the forms 9 1 A . . . 9 n A uj l and 9 1 A . . . 9 n A u> L 
with L subset of {2n + 1, . . . , d}. Therefore, the sublaplacian A 6 i k t satisfies (|6.23p at a if, and 
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only if, the integer k is not between n and n + d — 2n = d — n, that is, if, and only if, the condition 
X{k) holds at a. The proof is thus achieved. □ 



Finally, suppose that M is a CR manifold with Heisenberg structure H = ^(T^q © Tq^) and 
assume that TpM is endowed with a Hermitian metric with respect to which T^o and Tq i are 
orthogonal subspaces and complex conjugation is an isometry. Then we have df, = db + db, where 
db denotes the conjugate of db, that is, c^a = dbti for any uj £ C°°(M, Aj^H*). Moreover, as 
B b d* + d*d b = B*d b + d b B* b = (see Hi]) we get 

(7.24) A 6 = n 6 +0 6 , 

where is the conjugate of In particular, we see that the horizontal sublaplacian preserves 
the bidegree, i.e., it acts on (p, g)-forms. 

In fact, along the similar lines as that of BGJ pp. 151-156] and of the proof of Proposition 17.61 
above, one can show that the condition (|6.23|) at a point x € M for A& acting on (p, q)-forms is 
equivalent to the condition Y(p, q) below: 

(7.25) {(p, q), (q,p)} D {(k(x) + j, r(x) — k(x) + k); max(j, k) < n — r(x)} = 0, 

where (r(x) — k(x), n(x),n — r(x)) is the signature at x of the Levi form Lg associated to some 
non- vanishing real 1-form 9 anihilating Ti o©To i< In particular, when M is K-strictly pseudoconvex 
the Y(p, q) reduces to (p, q) ^ (k, n — k) and (p, q) ^ (n — k, k). 

7.4. Contact complex and the contact Laplacian. Given an orientable contact manifold 
(M 2ra+1 ,#) the contact complex of Rumin |Ruj can be seen as an attempt to get on M a com- 
plex of horizontal differential forms by forcing out the equalities d\ = and (c^) 2 = as follows. 

Let H = ker# and assume that H is endowed with a calibrated almost complex structure 
J e EndR H, J 2 = -1, so that d9(X,JX) = -d6{JX,X) > for any section X of H. We then 
can endow M with the Riemannian metric gg = dO(.,J.) + 9 2 . 

In addition, let T be the Reeb fields of 6. Then we have 

(7.26) d 2 b = -C T e{d6) = e{d6)£ T , 

where e(d9) denotes the exterior multiplication by d9. 

There are two ways of modifying the space A^H* of horizontal forms to get a complex. The first 
one is to force the equality d\ = by restricting the operator df, to := kere(d6) n A^H* since 
this bundle is stable under db and on there d 2 vanishes. 

The second way is to similarly force the equality (c^) 2 = by restricting dt to A\ := ker i(d6) n 
AqH* = (ime((i0))- L n A^H*, where i(dO) denotes the interior product with dO. This amounts to 
replace db by the operator ix\ o d b , where tt\ is the orthogonal projection onto A^. 

On the other hand, since dO is nondegenerate on H the operator e{d6) : A^H* — > A^ 2 H* is 
injective for k < n — 1 and surjective for k > n + 1. This implies that A| = for k < n and A^ = 
for A; > n + 1. Therefore, we only have two halves of complexes. The key observation of Rumin is 
that we get a full complex by connecting the two halves by means of the (second order) differential 
operator, 

(7.27) D R : A" — ► A n 2 + \ D R = C T - d^idff)- 1 ^ 

where e(d9)~ l is the inverse of e(d6) : A^iF — > A^ +1 H*. In other words, letting A k = A± for 
A; = 0, . . . , n — 1 and A k = A k for k = n + 1, . . . , 2n, we have the chain complex, 

(7.28) C°°(M) d A ...H C°°(M,A?) ^ C°°(Af,A5) ^ ... *5 C7°°(M,A 2n ), 

where : C°°(M, A fc ) -> C°°(M,A fc+1 ) is equal to tti o d h for A; = 0,... ,n - 1 and to d 6 for 
k = n + 1, . . . , In. This complex is called the contact complex of M. 
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(7.29) A 



The contact Laplacian A R : C°°(M, A* A") -» C°°(M, A* A J) is given by the formulas, 

(n - k)d R d* R + (n-k + l)d* R d R on A fc , A; = 0, . . . , n - 1, 

(d R d R ) 2 + D R D R " on A?, 

DrD* r + (d R d* R ) on A3, 

(n - + l)d R d* R + (n - k)d* R d R on A fc , A; = n + 1, . . . , 2n. 

By comparing the contact Laplacian A R to the horizontal sublaplacian A& Rumin |Ruj was able 
to show that on every degree A^ satisfies the Rockland condition at every point. He then used 
results of Helffer-Nourrigat ( HN3J to show that A R was maximal hypoelliptic. 

Alternatively, since in the contact case both d9 and C are nondegenerate on H, once the Rockland 
condition is granted we may directly apply Proposition 15.91 to get: 

Proposition 7.7. 1) For k = 0, . . . ,2n with k ^ n the contact Laplacian A R acting on sections of 
A k has an invertible principal symbol of degree —2, hence admits a parametrix in ^J^(M, A k ) and 
is hypoelliptic with loss of one derivative. 

2) For k = n the contact Laplacian A R acting on sections of A™ has an invertible principal 
symbol of degree —A, hence admits a parametrix in tyTr (M, AJ) and is hypoelliptic with loss of two 
derivatives. 

8. Proof of Proposition 13.181 
First, we need the lemma below. 
Lemma 8.1. For Km > we have JC m (U x R d+1 ) c C°° (U)®C^ (R d+1 ) . 

Proof. Let N = [^p] and let a be a multi-order such that \a\ < N. As (a) < 2\a\ < —{k + d + 2) 
the multiplication by £ Q maps S m (U x R d+1 ) to C°° (U)®L 1 (R d+1 ) . Composing it with the inverse 
Fourier transform with respect to £ then shows that the map p — > d y p^ y maps S m (U x 
to C°°(U)®C°(R d+1 ). It then follows that for any p G S*(I7 x R d+1 ) the transform p^ y (x,y) 
belongs to C°°(U)®C N (R d+1 ). 

Now, UK G K, m (UxR d+1 ) then bv Lemma EHl there exists p G S™ (U xR d+1 ) , rh = -(m+d+2), 
such that K(x,y) is equal to p^ y (x,y) modulo a smooth function. Hence K(x,y) belongs to 
C°°(U)®C N (R d+1 ) . The lemma is thus proved. □ 

We are now ready to prove Proposition 13.181 Let U be an open subset of M. d+1 together with a 
hyperplane bundle H C TU and a if-frame of TU and let <f> : (U, H) — > (U, H) be a Heisenberg 
diffeormorphism. Let P € ^^(V) and set P = <p*P. We need to show that P is a ^//DO of order 
m on U. 

First, by Proposition 13. 161 the distribution kernel of P takes the form, 

(8.1) kp(x,y) = \^\Kp(x,-£ S (y)) + R(x,y), 

with Kp(x,y) in IC m (U x R d+1 ) and R(x,y) in C°°(U x U). Therefore, the distribution kernel of 
P = (j)*P is given by 

(8.2) k P (x,y) = W{v)\hp{<l>{x),<l>{y)) = \e' x \K(x, -e x {y)) + %>(x), 0(y)), 

where K is the distribution onU = {(x,y) G U x e~ 1 (— y) £ U} C U x R d+1 given by 

(8.3) K(x,y) = \d y $(x,y)\Kp((j)(x),$(x,y)), $(x,y) = -e m o <j> o £^(-y). 
Next, it follows from |Po21 Props. 3.16, 3.18] that we have 

(8.4) $(x,y) =-(f>' H (x)(-y) + e(x,y) = <f>' H (x)(y) + Q(x,y), 
where Q(x, y) is a smooth function on U with a behavior near y = of the form 
(8-5) G(x, y ) = (0(||y|| 3 ),0(||y|| 2 ),...,0(|| y || 2 )). 
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Then a Taylor expansion around y = 4>' H {x)y gives 

(8.6) K(x,y)= Y \d y ^{x,y)\^^{d^Kp)^{x),<l>' H {x)y) + R N {x,y), 

(ci)<N 

(8.7) R N (x,y) = Y \W{*>V)\^T- ['(t-^dgKpttW^tix^dt. 

where we have let ^(x, y) = 4>' H {x)y + tQ(x, y). 

Set f a (x,y) = \d y $(x, y)\Q(x, y) a . Then (|8,5|) implies that near y = we have 

(8.8) f a (x,y) = (||y|| 3a »+ 2 ^+-+^)) = 0(\\y\\l@). 

Thus all the homogeneous components of degree < |(a) in the Taylor expansion for f a (x,y) at 
y = must be zero. Therefore, we can write 

(8-9) fa(x,y)= Y fap{x)—+ Y r Naf3(x,y)y 13 , 

where we have let f a ^(x) = dy f a (x,0), the functions rM a p(x,y) are in C°°(U) and the notation 
(j3)=^N means that ((3) is equal to if |iV is an integer and to |iV + ^ otherwise. Thus, 

(8.10) K{x,y)=J2 Y K af3 (x,y)+ Y R N a (x,y) + RN(x,y), 

(pi)<N |( q )<^<|at (a)<N 

where we have let 

(8.11) K aP {x,y) = f a p(x)yP(dy*K p )(0(x),0' H (x)y), 

(8.12) R Na (x,y)= Y r M *p(x,y)yP(d%Kp){<l>{x),<t)' H {x)y). 

As in the proof of Proposition 13.161 the smoothness of 4>' H {x)y and the fact that 4>' H (x)(\.y) = 
\.(j) H >(x)y for any A G R imply that K a p(x,y) belongs to K7 il -@ + @(U x R d+1 ). Notice that if 
< <$=§iV then Km - (a) + ^ > Km + > Km + f . It thus follows from Lemma IO that, 
for any integer J, the remainder term Rno is in C J (U x M rf+1 ) as soon as ./V is large enough. 

Let ir x : U x — > £/ denote the projection on the first coordinate. In the sequel we will say 
that a distribution K(x,y) E T>'(U x M rf+1 ) is properly supported with respect to x when n x \ suppK 
is a proper map, i.e. for any compact L C U the set supp-fT n(Lx M d+1 ) is compact. 

In order to deal with the regularity of R]y(x,y) in Q8.7j) we need the lemma below. 

Lemma 8.2. There exists a function Xn £ C^ilA) properly supported with respect to x such that 
x(x,y) = 1 near y = and, for any multi-order a, we can write 



(8.13) X (x,y)Q(x,y) a = Y a/ 3{t,x,y)<f> t (x,yf 

where the functions 9 Q/ 3(t,x,y) are in C°°([0, 1] x U x M d+1 ). 

Proof of the lemma. Let U' be a relatively compact open subset of U and let (to^o) € [0, 1] x {/'. 
Since $i (:co>0) = and d y &t {xo, 0) = ^(xo) is invertible the implicit function theorem implies 
that there exist an open interval I Xo containing t Xo , an open subset U Xo of U containing xq, open 
subsets V xo and V xo of containing and a smooth map ^ xo {t,x,y) from 7^ x U XQ x 14 to 
V^. such that U XQ x T4, is contained in U and for any (t,x,y) in I xo x U XQ x 14 and any y in 
we have 

(8-14) y = ^ t ( X ,y) ^y = iS xo (t,X,y). 
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Since [0, 1] x V is compact we can cover it by finitely many products I x , x U Xk , k = 1, ..,p, with 
{tki x k) & [0, 1] x U' . In particular, the sets I = Uj-Ik and U" = UC/^ are open neighborhoods of I 
and U' respectively. Thanks to (j8.14j) we have ^> Xk = on (I Xk x U Xk x V Xk ) n (I^ x t^, x V^,). 
Therefore, setting V = HfcVfc and F = HfcVfc we have U" xV <ZlA and there exists a smooth map 
^ from / x U" x V such that for any (t, x, y) in I x 17" x V and any y in V we have 

(8.15) y = $ t (x, y)^y = *(t, x, y). 

Furthermore, as t%*(i,x,0) = [<9 y <I> t (x, 0)]" 1 = <// H (x) _1 and (/) / H (x)" 1 (A.y) = \<p' H {x)~ l {y) for 
any A G M, the function 0(x, ^(t, x, y)) behaves near y = as in 1)8.5(1 . Therefore, as in (|8.8j) - (|8.9|) 
for any multi-order a we can write 

(8.16) Q(x,^(t,x,y)) a = Y 0*p(t,x,y)f, 9 a/3 (t,x,y) e C°°(I x U" x V). 
Setting y = <I> t (x,y) then gives 

(8.17) e(x,y) a = Y a p(t,x,y)$ t (x,y)P, 9 a/3 (t,x,y) G C°°(I x U" x V). 

All this allows us to construct locally finite coverings {U' n ) n ->o and (U") n >o of U by relatively 
compact open subsets in such way that, for each integer n, the open U" contains U' n and there 
exists an open V n C containing so that, for any multiorder a, on [0, 1] x x V n we have 

(8.18) @(x,y) a = Y, 0<$(t,x,y)$ t (x,yf, 9^(t,x,y) G C°°([0, 1] x U" x V n ). 

For each n let G C^°(U^) be such that </> n = 1 on U' n and let if) n G C^°(V^) be such that 
ij) n = 1 on a neighborhood of 0. Then we construct a locally finite family (x«)n>o C C£°(U) as 
follows: for n = we set Xo(x>2/) = l Po(x)ipo(y) and for n > 1 we let 

(8.19) Xn{x,y) = (l - </?o(a;)'0o(y)) ... (l - ^„-l(x)^n-l(y)Vn(20^n(y)- 

Then x = S Xn is a well defined smooth function on U x supported on D n >o(U^ x V n ) C 
hence properly supported with respect to x. Also, as x(x, y) = 1 on each product C/^ x we see 
that x( x , y) = 1 on a neighborhood of U x {0}. In addition, thanks to 1)8.18(1 on [0, 1] x U we have 

(8.20) x(x,y)@(x,y) a = Yxn(x,y)e(x,y) a = Y a p(t, x,y)^ t (x,yf , 

where the functions 6 a p{t, x, y) := J2 n Xn(x, y)9^g(t, x, y) are in C°°([0, 1] x [/ x The lemma 

is thus proved. □ 

Let us go back to the proof of Proposition 13.181 Thanks to (|8.7|) and 1)8. 13|) on [/ x R we have 

(8.21) X (x,y)R N (x,y) = Y E / r a (,(t,x,y)(fd^K p )(^x)^ t (x,y))dt, 

for some functions r a p(t, x, y) in C°°([0, 1 x xR d+1 ). Since y p d§Kp belongs to ^^(f/xlR^ 1 ) 
it follows from Lemma 18. II that, for any integer J > 0, as soon as A is taken large enough y^d^Kp 
is in C J (U x R d+1 ) and so x(x,y)R N (x,y) is in C J (U x IR d+1 ). 

On the other hand, set Kp(x,y) = x( x ,y)K(x,y) = ^2xn(x,y)K(x,y). Since x( x ,y) is sup- 
ported in U and is properly supported with respect to x this defines a distribution on U x M. d+1 . 
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Moreover, using (|8.1UI) we get 

3 

(8-22) K P (x,y)= £ £ K af3 (x,y) + J2 R N, 

^<7V|^<^ < | JV j=l 

(i) 

where the remainder terms R)/~, j = 1, 2, 3 are given by 

(8-23) = x(x,y)R N {x,y), R$ = ^ x(x, y)R Na (x, y), 

(a)<N 

(8-24) R$(x,y)=Y, E (1 ~ X^,y))K a/3 (x,y). 

{d/<N |( a )<(^<|Ar 

Each term K af3 (x,y) belongs to /C™^ +< ^([7 x R d+1 ) and, as m + - (a) = m + j and | (a) < (5f> 
imply (a) < 2j and (/3) < |j, in the r.h.s. Q8.22JI there are only finitely many such distributions in a 
given space lC m+ i(U x R^ 1 ) as a and (5 range over all multi-orders such that |(a) < ({3). 

Furthermore, the reminder term pJ^ is smooth and the other remainder terms Rjj) , j = 1,2, 
are in C J (U x R d+1 ) as soon as iV is large enough. Thus, 

(8-25) K P (x,y)~ K afi(x,y), 

which implies that ifp belongs to IC m (U x M d+1 ) and satisfies (|8.25|) . 

Finally, from Q8.1JI and the very definition of &(x,y) on U x {/, we deduce that the distribution 
kernel of P is equal to 

(8.26) \e' x \K P (x, -e x {y)) + [1 - x (a?, e x (y))]\e' m \K p (cf>{x), -e m o 0(y)) + P(<£(x), 

= |e;|ifp(x, -£„(!/)) mod C°°(C7 x [/). 

Combining this with Proposition ^. 16l and the fact that Kp(x, y) satisfies (|8,25[) completes the proof 
of Proposition 13.181 

9. Proof of Proposition 13.211 

Let P : C%°(U) — > C°°(U) be a ^//DO of order m and let us show that its transpose operator 
P* : C^°(U) — > C°°(£7) is a ^#DO of order m. By Proposition l3~Tfil the distribution kernel of P is 
of the form, 

(9.1) k P (x, y) = \e' x \K P (x, -e x (y)) + R(x, y), 

with Kp(x, y) in }C m (U x R d+1 ) and R(x, y) in C°°(U x f7). Thus the distribution kernel of P* can 
be written as 

(9.2) k P t(x,y) = k P (y,x) = \e' y \K P (y, -e y {x)) +R(y,x) = \e' x \K(x, -e x (y)) +R(y,x), 
where K is the distribution on the open U = {(x,y); e~ l {—y) G U} given by 

(9.3) K(x,y) = \e' x \- l \e y \Kp(e-\-y),-e E -, { _ y) {x)). 
Lemma 9.1. On U we have 

(9-4) e £ - 1{ _ y) (x) = y-Q(x,y), 

where © : U — > R d+1 is a smooth map with a behavior near y = of the form \8. 5\) . 
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Proof. Let (x, y) £ U and Y € G X U let X y (Y) = y.Y, that is, X y is the left multiplication by y on 
G X U. Then by |Po2l Eq. (3.32)] for Y small enough we have 

(9.5) lime, o e;} 1{t _ y) (t.Y) = \_ y (Y) = X y 1 (Y). 

Since e x o e~\ ,(t-Y) is a smooth function of (t,Y) near (0,0), it follows from the implicit 
function theorem that for Y small enough we have 

(9-6) tar^o^ = X y (Y). 

In particular, for Y = we get 

(9.7) limt' 1 .s e - lit _ y) (x)=y. 

Now, the function ^-1/^(1) depends smoothly on (x,y) G U, so 1)9 . 7 j) allows us to put it into 
the form, 

(9-8) s E -i ( _ y) (x) = y-e(x,y), 

where Q = (&o, . . . , ®d) is smooth map from U to M. d+1 with a behavior near y = of the form 

(9.9) e (x,y) = o(|y | 2 + |yol|y| + |y| 3 ), e,(z,y) = 0(\y\ 2 ), j = i,...,d. 

In particular, near y = the map has a behavior of the form (]8.5[) . □ 
Next, a Taylor expansion around (e~ 1 (— y), — y) gives 

(9.10) Jf(*,y) = £ |4|-l|^|^)!(a«if P )( e -i(- y ) > - y ) + fl w (x ) y) > 

(9.11) R N (x,y)= l^r'Kl^T^ hl-tf-^KpHe-H-y^tfay)), 

{a)=N a ' J ° 

where we have let $t(x, y) = —y + iO(x, y). 
-i \-l\ P i I H x ,v 

-x\ Fj/I a! 



Let a Q (x, y ) = | e ^|-l| e ' Then because of (jH^J the same arguments used to prove 1)8. 9|) 



show that there exist functions r^ a (x,y) E C°°(U), (j3)=^N, such that 
(9.12) a Q (x,y) = ^ a afj (x)y p + ^ r Na (x,y)y fi 



where we have let a aj g(x) = ^c^a^x, 0). Thus, 

(9.13) K(x, y )=Y J E f^)v p (^K P )(e- 1 (-y),-y) + E R Na (x,y) + R N (x,y), 

^<iV|(4<^<|JV H<A r 

(9.14) R Na (x,y) = £ r WQ (x,y)y /3 (a^p)(e- 1 (-y),-y). 

Next, a further Taylor expansion shows that (dy Kp)(e~ 1 (—y), —y) is equal to 

(9.15) £ I( £ - 1 (-y)-xr(a2a^p)(x,-y)+ £ f (l-t) N -\d2d^K P )(8 t (x,y),-y), 

where we have let Et(x,y) = x + t(e~ 1 (— y) — x). Since e~ 1 (— y) — x is polynomial in y of degree 2 
and vanishes for y = 0, we can write 

(9.16) —(e-^-y) - x) 7 = J] a lS (x)y 5 , b yd (x) = -^—{d y {e~ l {-y) - x) 7 ] y=0 . 

|7|<I<5<2| 7 | 7 ' ' 
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Therefore, we can put K(x, y) into the form, 

(TV) 

(9.17) K(x,y) = ^2 K a/3y s(x,y)+ ^ ^ R Na p(x,y)+ ^ R Na (x,y) + R N {x,y), 

«,/3,7,<5 (a><TV |( a }<^<|AT (a)<TV 

where the first summation goes over all the multi-orders a, (3, 7 and 5 such that (a) < N, |(a) < 
(ft < |iV and |7| < \S\ < 2\j\ < 2N, and we have let 

(9.18) K a p 7 s(x,y) = a a ^s{x)y f3+5 {d2dyK P )(x, -y), f a p~fs{x) = a afj {x)b l5 {x) , 

(9.19) R Na p{x,y)=Y J E a ^s(x)y^ +s [' (1 - tf- 1 ^ K P )(e t (x,y), -y). 

| 7 |=TVTV<|<5|<2TV ^° 

Now, the distribution y^K P (x,-y) belongs to x M d+1 ). In particular, if |(a) < 

i(3j=lN then Sfm- (a) + (fff > > !Rm+ ±JV. Therefore, for any given integer J Lemma 18. II 

tells us that y^Kp{x, —y) is in C J (U x as soon as N is large enough. It follows that all the 

remainder terms RN a {x,y), (a) < N, belong to C J (U) for N large enough. 

Similarly, if §(a) < ® and j 7 | = N < \S\ < 2N then Km- (a) + (5) + ® > »m + ® > »m + §JV, so 
using Lemma l8~TI we see that y^ +s (d2dyKp)(x, —y) is in C J (U x M ^ 1 ) for N large enough. It then 
follows that for N large enough the remainder terms RNa/3{x,y) with (a) < TV and < ((3)=^N 
are all in C J (U) as soon as iV is chosen large enough. 

In order to deal with the last remainder term R]y(x,y) notice that, along the same lines as that 
of the proof of Lemma 18.21 one can show that there exists a x £ C°°{U) properly supported with 
respect to x such that x( x , y) = 1 near y = and, for any multi-order a, we can write 

(9.20) X (x,y)e(x,y) a = £ 9 af3 (t, x, y)$ t (x, yf, 

®=f<o) 

where the functions a p(t, x, y) are in C°°([0, 1] x [7 x M d+1 ). Then we can put x{ x , y)R^{x, y) into 
the form, 

(9.21) x (x,y)R N (x,y) = £ E Kr'l^l / ^(^^y)^^)^- 1 ^),^^^)), 

for some functions r Noi p(t,x,y) in C°°([0, 1] x C7 X R d+1 ). As (y^d^Kp) is in /C A "^ + ^([/ x R d+1 ) 
and we have SRm — (a) + ({3) > Km + i(a) = Km + iiV, using Lemma l8.ll we see that for N large 
enough xi x ,y)RN(x,y) is in C J (U), so is in C J (U x M a!+1 ) since x( x ,y)RN(x,y) is a properly 
supported with respect to x. 

Let Kpt(x,y) = x( x ,y)K(x,y). This defines a distribution on C7 x ]R d+1 since x is properly 
supported with respect to x. Moreover, we have 

(TV) 4 

(9.22) K pt (x,y) = ^ K *pA x >v) + E^SW), 

(7) 

where the remainder terms , j = 1, . . . , 4, are given by 

(9.23) R^ = x(x,y)R N (x,y), R$ = ^ x( x >y) R Na(x,y), 

(a)<N 

(TV) 

(9.24) E E x(x,y)R Naf 3{x,y), R$ = £ (1 - xix^K^ix^). 

(4<TV |( Q }<(^<|Ar a,/3,7><5 
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Note that (x, y) belongs to /C™-< a >+<T>+<<5> (U x R d+1 ) and there are finitely many terms of a 

given order as a, (3, 7 and 5 ranges over all the multi-orders such that < ((3) and I7I < \5\ < 2\j\. 

On the other hand, the remainder term is smooth and it follows from th observations above 
that the other remainder terms are in C J (U x R d+1 ) as soon as ./V is large enough. Thus, 

(9.25) K P t(x,y) ~ ^ ^ K a ^ s (x, y), 

l(d)<& [7[<l*[<2|7l 

which incidentally shows that Kpt(x,y) belongs to rC m (U x 

Finally, thanks to 1)9.2(1 we can put the kernel of P l into the form, 

(9.26) k P t(x,y) = \e' x \K P (x,-e x (y)) + \e' x \[(l - X )K](x,-e x (y)) + R(y,x) 

= \e' x \K P (x, -e x {y)) mod C°°(U x 17). 

It then follows from Proposition I3.1b1 that P t is a ^//DO of order m. Moreover, working out the 
expression for shows that the asymptotics expansion (|9.25|) reduces to (|H.H7|) . The proof of 

Proposition IH.21I is thus achieved. 
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